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Chapter  1 


INTRODUCTION 


Statement  of  Problem 

In  recent  years,  the  Air  Force  has  attempted  to  use 
various  warranty  methods  to  improve  the  quality  of  procured 
systems  and  to  gain  greater  commitment  of  suppliers  to  pro¬ 
duct  quality.  Industry  has  also  made  extensive  use  of  war¬ 
ranties,  "as  an  obligation  of  the  seller  to  the  buyer  with 
respect  to  title,  quality,  quantity,  state,  or  past  or  fu¬ 
ture  perf ormability  of  goods  sold  or  to  be  sold  [2:4]."  Be¬ 
cause  of  the  potential  benefits  to  the  Air  Force,  General 
Slay,  Commander  of  Air  Force  Systems  Command  (AFSC),  has 
stated  that  such  commercial  practices  should  be  incorporated 
in  Air  Force  procurements  (22:1).  A  need  therefore  exists 
to  determine  the  criteria  used  by  the  U.S.  commercial  air¬ 
lines  to  evaluate  aircraft  warranties  and  to  determine  if 
these  criteria  can  be  used  in  Air  Force  Systems  Command  air¬ 
craft  procurements. 

Definitions 

In  order  to  establish  a  consistent  framework  of 
terms  dealing  with  the  subject  of  government  and  commercial 
aircraft  warranties,  some  of  the  common  terms  of  this  sub¬ 
ject  will  be  defined  for  purposes  of  this  thesis. 
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In  this  thesis,  a  contractor  is  a  company  or  company 
representative  that  is  selling  goods  or  services  to  either 
the  government  or  a  purchaser  in  the  civilian  marketplace. 

A  purchase  contract  is  a  vehicle  through  which  the 
contractor  and  the  purchaser  agree  on  the  terms  of  trade. 

The  term  "contract"  will  be  used  herein  to  identify  a  pur¬ 
chase  contract.  A  contract  encompasses  the  following  charac¬ 
teristics: 

(1)  agreement  ("meeting  of  minds")  resulting 
from  an  offer  and  an  acceptance;  (2)  consideration, 
or  obligation;  (3)  competent  parties;  and  (4)  a 
lawful  purpose  [14:492]. 

A  warranty  is  "a  contractual  obligation  that  pro¬ 
vides  incentives  for  a  contractor  to  satisfy  a  system's 
field  operational  objectives  £2: 3-217."  While  a  warranty  is 
a  contractual  obligation  of  the  contractor,  it  also  spec¬ 
ifies  the  limitations  of  the  contractor's  liability.  In 
short,  the  warranty  specifies  what  the  contractor  is  and  is 
not  liable  for.  A  warranty  need  not  be  spelled  out  in  the 
contract.  The  Defense  Acquisition  Regulation  (DAR)  states 
that  "a  warranty  is  a  promise  or  affirmation  given  by  a  sel¬ 
ler  to  a  purchaser  regarding  the  nature,  usefulness,  or  con¬ 
dition  of  the  supplies  or  performance  of  services  to  be 
furnished  [23:55]." 

There  are  two  kinds  of  warranties  found  in  trade  - 
expressed  and  implied.  While  a  distinction  will  be  made  be¬ 
tween  these  and  also  in  the  kinds  of  expressed  warranties 
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for  purposes  of  definition,  it  does  not  imply  that  these  war¬ 
ranties  are  mutually  exclusive.  In  practice,  the  differences 
between  warranty  types  are  often  obscure.  The  Uniform  Com¬ 
mercial  Code  (UCC)  specifies  two  aspects  of  an  implied  war¬ 
ranty  ; 

the  implied  warranty  of  merchantability,  which 
warrants  that  the  article  sold  shall  be  of  the 
general  kind  described  and  reasonably  fitted  for 
the  general  purpose  for  which  it  is  sold,  and  the 
implied  warranty  of  fitness  for  a  purpose,  which 
warrants  that  the  goods  sold  are  suitable  for  the 
buyer's  special  purpose  [7:31-32]. 

In  the  absence  of  any  other  statement  concerning  warranty  or 
guarantee  in  a  contract,  the  implied  warranty  is  considered 
to  be  in  effect.  The  second  type  of  warranty  identified 
in  the  UCC  is  the  expressed  warranty,  that  is,  "any  affirma¬ 
tion  of  fact  or  promise  made  by  the  seller  to  the  buyer  and 
relating  to  the  goods  [7:31]-" 

For  purposes  of  this  analysis,  the  expressed  war¬ 
ranties  will  be  further  defined  into  two  categories.  The 
first  is  the  commercial  warranty  which  is  simply  an  ex¬ 
pressed  warranty  between  a  contractor  and  buyer  other  than 
the  government.  Within  this  category  is  the  commercial  air¬ 
craft  warranty  which  is  a  warranty  between  an  aircraft  or 
aircraft  system  contractor  and  a  commercial  airline.  The 
second  type  is  the  Department  of  Defense  (DOD)  expressed 
warranty.  The  DOD  warranty  is  a  warranty  used  by  DOD  pur¬ 
chasers  in  conformance  with  the  DAR.  Warranties  on  air¬ 
craft  purchased  by  the  Air  Force  are  considered  to  be  a  sub¬ 
set  of  DOD  warranties  for  purposes  of  this  research. 
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According  to  the  report,  "A  Study  of  the  Effective¬ 
ness  of  Warranties  in  Contracts  for  Military  Hardware," 
there  are  five  types  of  expressed  warranties  in  procure¬ 
ments.  They  are:  Correction  of  Deficiencies,  Failure  Free 
Warranty  (FFW),  Reliability  Improvement  Warranty  (RIW),  Mean 
Time  Between  Failure  (MTBF)  Guarantee,  and  Logistics  Sup¬ 
port  Commitment  (LSC)  (2:5*0 -5-5) • 

Justi fi cation 

A  thesis  done  at  the  Air  Force  Institute  of  Tech¬ 
nology’s  School  of  Systems  and  Logistics  in  1975  stated  that 
very  little  research  has  been  done  "to  compare  commercial 
airline  warranty  procedures  with  those  in  the  Air  Force. 

This  area  promises  to  provide  a  great  deal  of  potential  ben¬ 
efits  [5: 65-66]."  Actual  benefits  to  commercial  airlines  in 
their  use  of  warranties  are  substantial.  A  study  done  in 
1974  stated  "three  of  the  larger  airlines  realized  a  total 
combined  savings  of  $31,000,000  from  warranty  provisions  on 
avionics  equipments  alone  [5:22]." 

General  Slay,  Commander  of  Air  Force  Systems  Command 
has  directed  that  Air  Force  procurement  activities  use  com¬ 
mercial  practices  in  government  contracting  whenever  a  po¬ 
tential  benefit  to  the  government  can  be  gained  (22).  In 
order  to  determine  whether  a  potential  benefit  exists,  the 
contracting  officer  needs  criteria  upon  which  to  judge  the 
potential  benefits  of  any  warranty.  A  search  of  the  litera¬ 
ture  indicates  that  no  list  of  criteria  exists  to  evaluate 
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the  "benefits  of  using  a  commercial  aircraft  warranty  that 
are  used  by  the  airlines  which  can  be  applied  to  Air  Force 
aircraft  procurements  (2sI-IV).  However,  guidance  when  to 
include  warranties  in  military  acquisition  is  found  in  the 
DAR  (See  Figure  l). 

A  need  therefore  exists  to  identify  a  list  of  cri¬ 
teria  which  can  be  used  by  government  contracting  officers 
to  determine  if  benefits  can  be  gained  by  using  commercial 
techniques  in  the  purchase  of  aircraft  warranties. 


Advantages  of  Warranties 

The  reason  any  consumer  would  desire  a  warranty  is 
clear;  it  is  a  guarantee.  It  is  one  weapon  that  can  be  used 
in  "the  battle  [that]  has  been  and  is  still  raging  against 
inferior  and  bad  products  [18:21]."  The  reasons  why  a  war¬ 
ranty  is  desired  by  aircraft  operators  are  common  to  both 
the  airlines  and  the  Air  Force. 

First,  a  warranty  offers  a  guarantee  that  the  seller 
will  stand  behind  their  product,  that  they  will  assume  at 
least  part  of  the  risk  should  the  product  fail  to  perform  as 
the  seller  claims.  Hal  Bayer  and  Robert  Speir  of  Douglas 
Aircraft  Company  pointed  to  the  desire  of  airlines  to  get  the 
manufacturers  to  stand  behind  their  product  as  a  motivation 
for  seeking  a  warranty. 

When  a  potential  airline  customer  takes  heed 
of  the  manufacturer's  promises  of  design  service 
life,  excellent  test  results  and  low  maintenance 
cost,  the  potential  customer  is  quick  to  ask  us 
for  proportionate  assurances  defined  in  recover¬ 
able  dollars  [1:50]. 
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.  i.  Nature  of  the  item  and  use. 

ii .  Cost  of  the  Warranty  and  degree  of  price  competition 
as  it  may  affect  cost. 

iii .  Criticality  of  meeting  specifications, 

iv.  Damages  to  the  government  which  may  arise  in  the 
event  of  defective  performance, 

v.  Cost  of  correction  or  replacement  either  hy  the  con¬ 
tractor  or  another  source  in  the  absence  of  a 
warranty . 

vi .  Administrative  cost  and  difficulty  of  enforcing  a 
warranty. 

vii .  Ability  to  take  advantage  of  the  warranty,  as  con¬ 
ditioned  by  storage  time,  distance  of  the  using 
agency  from  the  source,  or  other  factors, 

viii .  Operation  of  the  warranty  as  a  deterrent  against 
deficiencies . 

ix.  The  extent  to  which  government  acceptance  is  to  be 

based  upon  contractor  inspection  or  quality  control, 

x.  Whether,  because  of  the  nature  of  the  item,  the 

government  inspection  system  would  not  likely  pro¬ 
vide  adequate  protection  without  a  warranty, 

xi .  Whether  the  contractor's  present  quality  program  is 
reliable  enough  to  provide  adequate  protection  with 
a  warranty,  or,  if  not,  whether  a  warranty  would 
cause  the  contractor  to  institute  an  effective  and 
reliable  quality  program. 

xii.  Reliance  on  "Brand  Name"  integrity, 

xiii.  Whether  a  warranty  is  regularly  given  for  a  com¬ 
mercial  component  of  a  more  complex  end  item. 

xiv.  Criticality  of  item  for  protection  of  personnel  or 
property,  e.g.  for  flight  safety, 

xv.  The  stage  of  development  of  the  item  and  the  state 
of  the  art. 

xvi .  Customary  truth  practices. 


Figure  1 


Factors  Used  in  Determining  Use  of 
Warranties  by  the  Air  Force.  (2:6.1) 
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The  risk  should  equipment  fail  to  perform  in  most 
consumer  products  is  evident,  that  is,  the  loss  of  the  in¬ 
vestment  in  the  product.  In  a  commercial  aircraft,  the 
economic  risk  is  far  greater.  Should  the  aircraft  fail  to 
perform,  the  potential  loss  could  include  the  very  survival 
of  the  airline  itself.  The  warranty  therefore  transfers 
this  risk,  which  is  both  "an  economic  and  business  risk 
[12s 60]. " 

Another  important  reason  a  warranty  is  desirable  is 
that  it  is  an  incentive  for  greater  reliability.  During  re¬ 
cent  years,  great  attention  has  been  paid  to  the  life  cycle 
cost  of  a  system.  It  is  recognized  that  the  initial  cost 
of  an  item  is  but  one  factor  in  total  cost,  that  replace¬ 
ment  parts  and  maintenance  costs  can  far  outweigh  small 
savings  in  the  initial  cost  of  the  case  of  a  poorly  built 
system.  In  an  attempt  to  limit  this  risk,  the  mean  time  be¬ 
tween  failure  (MTBF)  has  been  warranted.  Proponents  of  war¬ 
ranties  argue  that  savings  are  realized  because  "life  cycle 
costs  vary  inversely  with  MTBF  and  vary  directly  with  the 
average  unit  repair  cost  [5:5H-" 

Therefore,  one  approach  to  reduce  life  cycle  costs 
is  to  obtain  a  guarantee  for  MTBF.  This  guarantee  is  an  in¬ 
centive  for  the  contractor  to  meet  the  MTBF  and  to  improve 
the  product  as  new  technology  becomes  available.  Early  war¬ 
ranties  of  this  type  were  from  the  commercial  world,  that  is, 
they  originated  in  non-military  purchases. 
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One  of  the  first  attempts  of  a  long  term  serv¬ 
ice  warranty  directed  at  the  problem  of  increasing 
field  MTBF  was  the  Failure  Free  Warranty  concept 
introduced  "by  the  Lear  Siegler  Company  £5:53* 

As  Dunn  and  Oltyan  pointed  out,  the  term  "failure  free"  was 

a  misnomer  "because  the  guarantee  did  not  guarantee  no  failure. 

Hence  the  term  Reliability  Improvement  Warranty  (RIW)  is 

used  to  connote  the  presently  used  version  of  this  warranty 

(5:6). 


Another  reason  a  warranty  is  desired  is  that  it  re¬ 
moves  "the  finality  and  conclusiveness  of  acceptance  [12: 
57] • "  This  factor  is  alleged  to  be  the  main  value  of  the 
warranty  for  the  government . 

The  main  purpose  of  a  warranty  in  Government 
contracts  is  to  remove  the  finality  and  conclu¬ 
siveness  of  acceptance.  In  other  words,  the  gov¬ 
ernment  gets  more  time  to  uncover  latent  de¬ 
fects  [18:45]. 


Commercial  and  POD  Warranties 

on  Aircraft  Compared 

There  are  several  clear  differences  between  the  war¬ 
ranties  used  in  airline  aircraft  procurement  and  those  found 
in  Air  Force  aerospace  procurement .  Many  of  the  differences 
between  airline  and  Air  Force  procurements  center  around  the 
differences  in  the  systems  they  acquire,  objectives  in  their 
procurements,  and  the  warranties  themselves  (See  Figure  2). 
These  differences  will  be  addressed,  in  order  to  analyze  the 
context  in  which  the  warranty  is  either  sought  and  written, 
or  ignored. 
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COMMERCIAL 


AEROSPACE 


1 .  Many  customers 


2.  Items  fully  developed 
and  tested 


3-  Cost  of  item  usually 
small  in  comparison  to 
total  value  of  items 
sold 

4.  Item  in  continuous 
production 

5 .  Normal  environment  known 


6 .  Depending  upon  the  pro¬ 
duct,  maintenance  sys¬ 
tems  vary,  with  house¬ 
hold  products  the  mainten¬ 
ance  required  usually  must 
he  accomplished  by  an 
authorized  dealer;  commer¬ 
cial  aviation  products  are 
maintained  under  a  sophis¬ 
ticated  system  involving 
airlines,  airplane  manu¬ 
facturers  and  Government 
agencies  (e.g.,  FAA,  etc). 


1.  Single  Customer  (U.S. 
Government) 

2.  Items  often  to  be  de¬ 
veloped  and  pushing 
state-of-the-art . 

3.  Cost  of  item  usually 
large  with  respect  to 
total  value  of  items 
sold 

4.  Short  production  run 


5 •  Abnormal  environment  - 
not  always  known 

6.  Government  does  its  own 
maintenance,  supported 
by  Contractor's  tech¬ 
nical  data  and  field 
service  operations. 


Figure  2  Comparison  of  Warranty  Situation  for 
Commercial  Products  and  Aerospace 
Industry  Products  [18:44] 
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Clearly,  in  many  aircraft  procurements,  the  system 
acquired  "by  the  Air  Force  is  for  a  different  purpose  than 
that  "bought  "by  the  airlines.  Because  of  the  need  to  employ 
the  aircraft  in  combat  environments  and  missions,  they  often 
are  quite  different  in  design  and  performance  requirements. 
For  example,  the  KC-10,  while  similar  to  the  DC-10  has  the 
requirement  to  be  capable  of  several  missions  different  than 
that  of  the  commercial  version.  It  must  be  capable  of  off¬ 
loading  and  receiving  fuel  inflight  and  must  be  capable  of 
carrying  military  cargo.  Therefore,  much  of  the  equipment 
and  the  structure  must  be  specially  built  for  these  purposes. 
Further,  the  aircraft  is  required  to  be  at  the  highest  pre¬ 
sent  state-of-the-art  in  its  systems.  The  air  refueling 
system,  for  example,  employs  a  system  that  permits  refueling 
of  both  receptacle  and  probe  and  drogue  receivers  in  the 
same  flight,  which  was  not  possible  in  the  KC-135-  The  risk 
to  the  contractor  in  guaranteeing  such  equipment  may  be 
greater  than  in  the  commercial  version,  which  uses  standard 
equipment . 

Beyond  these  clear  differences  in  the  intended  use 
of  the  aircraft  there  is  often  the  need  for  military  air¬ 
craft  to  be  operated  in  combat  roles.  The  potential  dif¬ 
ference  in  the  atmosphere  in  which  the  aircraft  is  operated 
places  further  uncertainty  into  the  possible  liability  of 
the  contractor.  This  is  because  the  aircraft  may  be  oper¬ 
ated  in  a  manner  far  different  than  that  envisioned  by  the 
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Air  Force  or  the  contractor  due  to  military  necessity.  The 
potential  unknown  effects  of  combat  employment  therefore  add 
more  risk  to  the  contractor  in  guaranteeing  such  equipment 
than  in  the  commercial  version. 

In  the  past,  the  Air  Force  has  done  its  own  mainten¬ 
ance.  The  airlines  use  a  system  in  which 

the  maintenance  required  usually  must  be  ac¬ 
complished  by  an  authorized  dealer;  commercial 
aviation  products  are  maintained  under  a  sophis¬ 
ticated  system  involving  airlines,  airplane  man¬ 
ufacturers  and  Government  agencies  (e.g.,  FAA, 
etc . )  [18: 44] . 

There  are  also  some  clear  differences  in  the  legal 
limitations  when  a  government  purchaser  attempts  to  buy  a 
product  when  compared  to  a  commercial  buyer.  As  Ron  Chalecki, 
a  contracting  officer  on  the  XC-10  project,  put  it  in  dis¬ 
cussing  the  KC-10  warranty: 

In  the  commercial  market-place,  the  competi¬ 
tion  fight  it  out  by  offering  their  best  overall 
'deal'.  While  we  recognized  that  we  had  to  live 
within  the  framework  of  Government  rules  and  re¬ 
gulations  [4:1]. 

Some  of  the  rules  Mr.  Chalecki  referred  to  are  not 
strictly  limitations  on  clauses  or  in  obtaining  the  best 
quality  for  the  lowest  price.  While  the  specifics  of  these 
limitations  are  outside  the  scope  of  this  study,  it  must  be 
recognized  that  these  limitations  do  exist  in  order  to  under¬ 
stand  the  context  in  which  the  government  views  a  potential 
purchase.  The  limitations  referred  to  are  those  oriented 
toward  socioeconomic  goals  such  as  equal  opportunity  of 
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minorities  and  small  "businesses.  These  constitute  clear 
limitations  placed  on  government  acquisitions  that  are  not 
placed  on  the  airlines. 

The  industrial  "buyer  is  free  to  choose  sup¬ 
pliers  on  the  "basis  of  total  value  ....  Many 
laws  and  executive  orders  influence  government 
purchasing.  A  large  number  of  these  laws  and 
orders  are  designed  to  achieve  socioeconomic 
goals  [14:564-565], 

Lest  the  conclusion  is  drawn  that  the  commercial 
buyer  has  a  clear  advantage  in  every  aspect,  it  is  well  to 
point  out  that  the  government  has  some  advantages  too: 

The  government  is  a  sovereign  and  as  such  can 
determine  the  conditions  for  doing  business  in  the 
government  market.  The  government,  for  example, 
regulates  the  actions  of  its  prime  contractors, 
even  to  the  point  of  determining  the  manner  in 
which  they  do  business  with  their  subcontractors 
[14,549]. 

Another  example  of  government  advantage  is  the  in¬ 
spection  clause,  which  will  be  covered  under  the  legal  as¬ 
pects  later  in  this  chapter. 

The  warranties  used  by  the  government  and  the  air¬ 
lines  are  similar  in  many  respects.  As  Mr.  Chalecki  pointed 
out  in  his  article  and  Captain  C.  Brandon  Gresham,  Jr.,  con¬ 
firmed  in  a  recent  interview,  "there  can  be  a  lot  of  simil¬ 
arities  between  the  correction  of  deficiency  [clause]  and 
the  standard  commercial  warranty  [9] . " 

The  inconsistencies  between  the  warranty  obtained 
by  the  airlines  and  the  government  are  pointed  out  by 
Charles  D.  Woodruff  in  his  article  "A  More  Critical  View  of 
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Warranties  and  Consequential  Damages  in  Government  Contracts." 
Mr.  Woodruff  stated  that  the  implied  warranty  for  a  par¬ 
ticular  purpose  is  not  normally  covered  in  the  commercial 
warranty  whereas  the  government  warranty  clause  is  aimed  at 
the  particular  purpose  for  the  item  (25:4-5). 

The  DAR  permits  the  use  of  the  commercial  warranty 
when  the  rights  of  the  government  are  not  changed.  But  as 
Woodruff  pointed  out,  because  of  the  coverage  of  the  stand¬ 
ard  government  clauses,  the  contracting  officer  is  probably 
unable  to  replace  the  DAR  clauses  such  as  the  Correction  of 
Deficiency  or  Warranty  of  Supply  with  the  commercial  war¬ 
ranty  . 


The. fourth  sentence  in  the  paragraph  discussing 
Commercial  Item  Warranties  does  permit  the  Govern¬ 
ment  to  adopt  the  contractor's  standard  commercial 
warranty  when  it  is  determined  by  the  Contracting 
Officer  that  its  provisions  are  not  inconsistent 
with  the. rights  afforded  the  Government  under  the 
clauses  in  7-105.7  (a)  and  (b),  or  other  provisions 
of  the  contract.  However  .  .  .  it  is  almost  in¬ 

conceivable  that  a  standard  commercial  warranty 
would  not  be  inconsistent  with  the  two  supply  war¬ 
ranty  clauses  [25:4-5]. 

Since  the  commercial  warranty  covers  the  performance 
rather  than  the  specific  purpose  of  the  item,  as  Captain 
Steven  C.  Lathrop,  instructor  of  Logistics  Management  at  the 
Air  Force  Institute  of  Technology  (AFIT),  pointed  out,  the 
commercial  airline  receives  a  warranty  which  is  far  longer 
in  duration  and  extensive  in  coverage  (13).  The  unique  in¬ 
tended  uses,  mentioned  earlier,  therefore  have  an  impact  on 
the  warranty  coverage. 
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Because  of  this  problem,  the  gpvemment  normally 
receives  a  warranty  that  is  of  shorter  duration  than  the 
commercial  warranty.  Despite  the  differences  in  the  other 
aspects,  this  is  the  principal  difference  between  the  war¬ 
ranty  the  commercial  airlines  receive  and  the  one  the  Air 
Force  receives  (9)- 

The  short  length  of  time  of  coverage  in  the  war¬ 
ranties  attained  by  the  government  was  pointed  out  as  a 
problem  in  a  recent  memorandum  which  states  that  "the  usual 
one  year  or  eighteen  month  period  of  coverage  after  accept¬ 
ance  (rather  than  use  of  the  item)  turns  out  to  be  insuf¬ 
ficient  [10:3]."  While  the  length  of  time  covered  in  war¬ 
ranties  attained  by  the  government  is  normally  shorter  than 
those  obtained  by  airlines,  greater  coverage  has  been  at¬ 
tained  by  the  government,  when  a  warranty  similar  to  a  com¬ 
mercial  warranty  is  negotiated  in  Air  Force  acquisition.  The 
warranty  on  the  KC-10  is  such  a  warranty. 

To  gain  an  idea  of  the  coverage  offered  on  the  com¬ 
mercial  airlines,  Figure  3  shows  the  length  of  warranties 
offered  by  Douglas  on  the  DC-8,  DC-9,  and  DC-10.  Also,  by 
way  of  comparison,  Figure  4  shows  the  warranty  given  by 
Douglas  on  the  KC-10  to  show  the  length  of  time  and  extent 
of  coverage  that  has  been  obtained  when  the  government  pur¬ 
sued  a  commercial  aircraft  warranty. 


Coverage 


DC-8 


DC-9 


DC-10 


1.  Defects  in  material  1  yr/2000  hr. 


Primary  Structure 


2.  Defects  in  design,  1  yr/2000  hr. 
selection  of  materials 
and  process  of  manu¬ 
facture  . 


4. 


Primary  Structure 

Failure  to  conform 
to  the  detail  specif¬ 
ication  . 

Primary  Structure 

Defects  in  installa¬ 
tion  of  vendor  parts. 


1  yr/2000  hr. 


1  yr/2500  hr.  2  yr/5000  hr.  or  3  yr/ 

3000  hr.  for  components 
not  subject  to  prior  in- 

2  yr/5000  hr.  spection,  including  pri . 

struct . 

1  yr/2500  hr.  18  mos . 


2  yr/5000  hr.  18  mos. 

2  yr/2500  hr.  2  yr/5000  hr. 


2  yr/5000  hr. 


2  yr/5000  hr. 


5*  Performance  guarantees 

6.  Warranty  labor 
reimbursement 


Direct  repair 
labor  only 


3  mos./400  hr. 

Direct  repair  Yes,  except  inspection 
labor  only  checkout  &  test  effort. 


Figure  3  Standard  Warranty,  DC-8,  DC-9>  DC-10  (Is  53)* 


Coverage 


DC-8 


DC-9 


DC-10 


7.  Provide  reimbursement 
at  operator's  direct 
labor  rate  plus  50 $ 
for  burden 

8.  Transportation  Costs  Operator  pays 

9.  Recycle  warranty 
period  for  repair,  re¬ 
placement,  correction 
or  redesign 

10.  Provide  service  life 
policy  for  primary 
structure 

11.  '  Provide  service  life 

policy  for  primary 
landing  gear  compon¬ 
ents  . 


Yes 


Operator  pays  DAC  pays  one  way. 
Yes 


10  yr/30,000  hr.  (pro 
rata) . 


10  yr/30,000  hr.  or 
20,000  landings  (pro¬ 
rata)  . 


Figure  3  (Continued). 


KEY  PROVISIONS 


COVERAGE 


TERM 


Defects  in  material  and  workmanship 

Defects  in  installation  of  vendor 
parts 

Defects  in  failure  to  conform  to 
specification 

Defects  in  design 

Service  Life  Policy 


60  months  or  5000 
hours 

60  months  or  5000 
hours 

6o  months  or  5000 
hours 

24  months 

10  years  or  30,000 
hours 


Figure  4  KC-10  ATCA  Warranty  and  Service  Life  Policy 

[15:10]. 


Legal  Aspects 

Government  supply  contracts  contain  an  inspection 
clause.  This  inspection  clause  allows  the  government  the 
right  to  examine  and  test  supplies  and  services  "to  deter¬ 
mine  whether  they  conform  to  contract  requirements  [23:7- 
103.5(a)]."  If  the  government  accepts  the  supplies  or  serv¬ 
ices  after  this  inspection  and  the  contract  does  not  contain 
any  warranty  provision,  the  government's  acceptance  is  conclu¬ 
sive  except  for  latent  defects,  fraud,  and  gross  mistakes 
(20:148). 

A  latent  defect  is  a  defect  which  existed  at  the 
time  of  government  acceptance  but  could  not  be  detected  by 
reasonable  inspection  (8:24).  A  latent  defect  can  then  be 
defined  in  terms  of  "reasonable  inspection."  For  example, 
if  the  government  were  buying  shoes, 
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a  visual  inspection  would  suffice  --  an  x-ray 
would  not  be  expected;  however,  in  the  examination 
of  welding  done  on  structural  steel,  an  x-ray  in¬ 
spection  could  be  reasonably  expected  [3:XVI-11]. 

If  the  subject  of  reasonable  inspection  becomes  an  issue,  it 

is  normally  settled  by  the  litigation  process. 

To  obtain  relief  for  a  defective  item  due  to  fraud, 
the  government  must  prove  "intent  to  deceive  by  the  con¬ 
tractor  in  that  he  misrepresented  a  material  fact  and  that 
the  government  relied  upon  the  misrepresentation  £3* XVI-ll] . " 
For  the  government  to  prove  gross  mistake,  the  government 
must  show  that  the  defect  is  so  gross  that  it  should  be  con¬ 
sidered  fraud  but  unlike  fraud,  the  government  does  not  have 
to  prove  intent  to  deceive.  In  obtaining  relief  from  de¬ 
fects  in  all  these  conditions,  the  burden  of  proof  rests  on 
the  government  (3:  XVI-11). 

Unlike  government  contracts,  commercial  aircraft 
contracts  do  not  contain  an  inspection  clause.  If  defects 
are  discovered  after  acceptance,  the  commercial  aircraft 
company  does  not  have  to  prove  that  the  defect  was  latent 
but  simply  that  the  defective  component  is  not  in  accordance 
with  the  contract. 

In  commercial  contracts,  the  aircraft  manufacturer 
specifically  excludes  any  implied  warranties  (18:57).  In 
the  case  of  Delta  Airlines,  Inc.  vs.  McDonnell  Douglas 
Corporation,  Delta  attempted  to  recover  expenses  suffered 
when  the  nose  gear  of  a  plane  purchased  from  McDonnell 
Douglas  collapsed.  The  plane  was  being  landed  and  when  the 
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nose  gear  collapsed  the  plane  veered  off  the  runway.  No  one 
was  injured.  Delta  claimed  that  McDonnell  Douglas  was  liable 
because  of  implied  warranty  but  the  court  ruled  that,  since 
the  contract  had  a  specific  exclusion  of  implied  warranties, 
McDonnell  Douglas  was  not  liable  ( 1 8 : 60 ) . 

In  government  contracts,  both  the  Correction  of  Defi¬ 
ciencies  clause  and  the  Warranty  of  Supplies  clause  as  de¬ 
fined  in  the  DAR  do  not  exclude  implied  warranties  (18:43). 

An  aircraft  manufacturer  can  be  held  liable  for  defective 
parts  under  an  implied  warranty  if  the  government  contract 
contains  either  one  of  these  two  clauses. 

While,  in  many  respects,  government  warranties  are 
different  than  commercial  warranties,  the  objective  in  ob¬ 
taining  warranties  for  commercial  aircraft  are  often  similar 
to  government  warranty  objectives.  The  question  is,  there¬ 
fore,  if  the  criteria  used  by  the  airlines  to  meet  these  ob¬ 
jectives  can  be  used  by  government  contracting  officers  in 
evaluating  the  potential  benefits  of  a  commercial  aircraft 
warranty.  Our  studies  indicate  that  the  criteria  used  in 
commercial  aircraft  warranty  evaluation  have  not  been  iden¬ 
tified.  Further,  the  question  whether  the  criteria  used  by 
the  airlines  could  be  effectively  applied  to  government  usage 
of  commercial  aircraft  warranties  has  not  been  addressed. 

Objectives 

The  primary  objective  of  this  study  is  to  identify 
criteria  for  application  of  commercial  aircraft  warranties 
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in  Department  of  Defense  acquisition  of  aircraft.  In  order 
to  accomplish  this,  the  following  objectives  must  be  met: 

1.  Develop  a  list  of  criteria  that  are  used  by  the 
airlines  to  determine  the  advantages  of  a  warranty. 

2.  Evaluate  applicability  and  legality  of  the  air¬ 
line  criteria  for  use  in  the  Air  Force. 

Research  Hypothesis/Questions 

Research  Hypothesis  (1)  The  airlines  use  a  homoge¬ 
neous  set  of  criteria  to  evaluate  warranties . 

Research  Question  (1)  Can  the  airline  criteria,  if 
they  exist,  be  legally  applied  to  Air  Force  aircraft  acqui¬ 
sitions? 

Research  Hypothesis  (2)  Contracting  experts  in  the 
Air  Force  agree  with  the  commercial  airline  contracting  per¬ 
sonnel  in  the  order  of  importance  of  the  criteria  used  in 
evaluating  warranties. 

Research  Question  (2)  Can  a  list  of  criteria  be 
developed  for  application  of  commercial  aircraft  warranties 
in  the  Department  of  Defense? 


20 


Chapter  2 


RESEARCH  METHODOLOGY 


Overview 

The  previous  chapter  provided  a  background  of  USAF 
warranty  experience  and  a  comparison  of  commercial  and  USAF 
aircraft  warranties.  The  need  to  identify  the  commercial 
criteria  and  to  determine  if  such  criteria  can  be  used  by 
the  Air  Force  was  also  discussed.  This  chapter  contains  a 
description  of  the  universe  and  populations  of  interest.  It 
also  includes  operational  definitions  of  variables  and  the 
method  of  data  collection.  Finally,  it  contains  an  explana¬ 
tion  of  the  procedures  used  in  analyzing  the  data  used  in  the 
research.  In  order  to  facilitate  reference  to  the  method¬ 
ology  in  answering  the  research  questions/hypotheses,  each 
is  addressed  separately  in  this  chapter. 

Description  of  Universe 

Because  this  study  is  limited  to  the  criteria  used 
in  evaluating  major  aircraft  purchases,  the  universe  is  the 
major  air  carriers.  More  specifically,  the  universe  is  com¬ 
posed  of  the  trunk  airlines,  and  the  United  States  Air  Force. 
It  should  be  noted  that  there  is  a  variety  of  consumers  of 
aircraft  not  included  in  this  study  because  the  objective  is 
to  determine  the  criteria  used  in  evaluating  the  warranties 
on  complex  aircraft  systems . 
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Description  of  the  Population 

of  Interest  *  '  " 


Our  population  is  the  criteria  used  by  contracting 
officials  of  the  major  air  carriers.  Major  air  carriers  are 
defined  here  as  the  trunk  carriers  in  the  continental  United 
States  (including  Pan  American),  as  defined  by  the  1979 
World  Aviation  Directory  (See  Appendix  B)  (21: 70)  and  the 
U.  S.  Air  Force.  For  purposes  of  comparison,  this  popula¬ 
tion  contains  two  subpopulations,  the  criteria  of  the  trunks 
and  of  the  Air  Force.  The  criteria  used  by  major  carriers 
are  discrete.  Conceptually  the  number  of  values,  that  is, 
the  number  of  criteria,  could  be  infinite.  However,  to 
focus  on  meaningful  criteria  the  criteria  are  considered  to 
be  multiple  or  having  7-19  discrete  values. 

Research  Hypothesis  1 

The  airlines  use  a  homogeneous  set  of  criteria  to 
evaluate  warranties . 

Data  Collection.  A  list  of  criteria  were  identified 
through  telephone  interviews  with  airline  contracting  experts 
from  all  ten  trunk  carriers.  This  list  was  then  given  to  Mr. 
Don  Robinson  of  the  ASD  Contracting  Office,  and  Captain 
Steven  C.  Lathrop  of  AFIT  to  review  the  list  for  complete¬ 
ness  and  to  offer  more  succinct  ways  of  stating  the  criteria. 

A  questionnaire  was  then  written  incorporating  the 
list  of  criteria  in  alphabetical  order.  The  instructions 
for  the  questionnaire  instructed  the  respondent  to  rank 
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order  the  criteria  in  order  of  importance  and  to  include  in 
the  ranking  any  criteria  they  wished  to  add  in  the  space 
provided  (See  Appendix  C) . 

To  validate  the  questionnaire,  it  was  administered 
to  AFIT  Graduate  Logistics  Class  of  1980  students  in  the  Con¬ 
tracting  and  Acquisition  major  who  had  previous  contracting 
experience  and  to  two  AFIT  faculty  members  who  had  contract¬ 
ing  experience.  Comments  on  the  readability  of  the  instruc¬ 
tions  and  the  criteria  were  solicited  from  each. 

The  sampling  plan  to  examine  the  homogeneity  of  cri¬ 
teria  used  by  the  trunk  carriers  was  to  randomly  select  nine 
trunk  carriers  using  a  computer  random  number  generator. 

The  chief  of  the  contracting  division  of  each  of  these  air¬ 
lines  was  then  contacted  and  asked  if  they  would  fill  out 
the  questionnaire.  An  alternate  airline  remained  and  would 
have  been  used  if  one  of  the  primary  contracting  chiefs  de¬ 
clined  to  participate. 

Identification/Definition  of  Variables.  In  collecting 
data  for  testing  Research  Hypothesis  1,  nine  commercial  air¬ 
line  chiefs  of  contracting  were  asked  to  rank  order  a  list 
of  criteria  which  were  used  in  evaluating  aircraft  warran¬ 
ties  in  order  of  importance.  The  most  important  criterion 
would  be  given  a  one  and  the  least  important  criterion  would 
be  given  a  twelve.  The  individual  criteria  are  the  indepen¬ 
dent  variables  and  the  ordinal  rankings  of  each  criterion  are 
the  dependent  variables.  The  questionnaire  in  Appendix  D 
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contains  the  specific  instructions  given  to  each  commercial 
airline  contracting  person  and  a  list  of  the  criteria  used 
in  evaluating  aircraft  warranties. 

Design  to  Test  Research  Hypothesis  1.  To  test  Re¬ 
search  Hypothesis  1  the  Kendall  coefficient  of  concordance  W 
was  used  to  determine  if  the  rankings  given  to  the  criteria 
by  the  nine  ccmnercial  airline  contracting  personnel  were 
the  same.  The  Kendall  coefficient  of  concordance  is  used  to 
measure  the  association  between  a  fixed  number  of  rankings 
from  any  number  of  respondents  (19:239).  When  using  the 
Kendall  coefficient  of  concordance,  the  null  hypothesis  (Hq) 
is  the  rankings  of  items  by  respondents  are  unrelated.  In 
this  research  the  null  hypothesis  is  the  rankings  given  to 
the  criteria  used  in  evaluating  warranties  by  the  nine  com¬ 
mercial  airline  contracting  personnel  are  not  related.  There¬ 
fore,  the  alternate  hypothesis  (H.)  is  the  rankings  of  the 
criteria  by  the  nine  commercial  airline  contracting  per¬ 
sonnel  are  related.  To  support  Research  Hypothesis  1  the 
results  of  the  Kendall  coefficient  of  concordance  test  must 
be  to  reject  the  null  hypothesis  (Hq)  and  conclude  the  alter¬ 
nate  hypothesis  that  the  nine  commercial  airline  contracting 
personnel  agree  on  the  rankings  of  the  criteria  for  eval¬ 
uating  aircraft  warranties. 

To  evaluate  this  test  an  alpha  value  of  .05  was  used. 
This  alpha  value  is  the  probability  of  rejecting  the  null 
hypothesis  as  false  when  the  null  hypothesis  is  actually 
true  (16:259,  266). 
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If  a  sample  size  of  seven  or  larger  is  used,  the 
test  statistic  W  follows  a  chi-square  distribution  with  N-l 
degrees  of  freedom  (19:23 6).  To  test  the  hypothesis  a 
critical  chi-square  value  can  be  obtained  from  a  statistical 
table  containing  chi-square  values. 

The  Kendall  W  test  was  performed  using  the  following 

steps: 

1.  The  null  hypothesis  (Hq)  is  the  rankings  given 
to  the  criteria  used  in  evaluating  aircraft  warranties  by 
the  nine  commercial  airline  contracting  personnel  are  not 
related.  The  alternate  hypothesis  (H^)  is  the  rankings  of 
the  criteria  by  the  commercial  airline  contracting  personnel 
are  related. 

2.  An  alpha  value  of  .05  was  chosen  for  the  test. 

3.  The  rank  order  scores  were  placed  in  a  table 
having  N  (12)  columns  (one  for  each  criterion)  and  K  (9) 
rows  (one  for  each  respondent)  (See  Appendix  G) . 

4.  The  Kendall  coefficient  of  concordance  W  was 
calculated  (See  Appendix  E) . 

p 

5.  A  chi-square  value  for  the  ranks  (x  ,  )  was 

]T  cLTLKS 

calculated  using  the  following  formula: 

4mkS  =  K<N-1>W 

where 

K  =  number  of  respondents 
N  =  number  of  criteria  ranked 
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W  =  Kendall  coefficient  of  concordance 
calculated  in  step  4. 

2 

5.  The  Xranjcs  was  compared  against  the  critical 
2 

value  of  x  with  eleven  degrees  of  freedom  obtained  from  a 

2 

statistics  table.  If  the  Xranjcs  is  less  than  the  critical 

2  2 
X  ,  then  the  null  hypothesis  cannot  be  rejected.  If  xranj!:s 

•  •  2 

is  greater  than  the  critical  x  the  null  hypothesis  can  be 
rejected.  The  conclusion  is  to  accept  the  alternate  hypoth¬ 
esis  that  the  nine  commercial  airline  contracting  personnel 
agree  on  the  rankings  of  the  criteria  used  in  evaluating 
aircraft  warranties  (19: 237) • 

Criteria  Test.  The  criteria  test  for  Research 
Hypothesis  1  addresses  the  question  of  whether  there  is  agree¬ 
ment  on  the  rank  order  of  criteria  used  in  evaluating  war¬ 
ranties  by  commercial  airline  contracting  personnel.  If  no 
agreement  exists  on  the  rankings  of  the  criteria  by  the  com¬ 
mercial  airline  contracting  personnel,  then  the  conclusion 
would  be  that  the  commercial  contracting  personnel  do  not 
use  a  homogeneous  set  of  criteria  but  each  contracting  person 
has  their  own  set  of  criteria  which  are  used  in  evaluating 
an  aircraft  warranty.  If,  however,  the  statistical  test 
shows  that  the  null  hypothesis  of  no  agreement  in  the  rank¬ 
ings  can  be  rejected  with  a  ^ 5%  confidence  level,  then  the 
conclusion  is  that  the  commercial  airline  contracting  per¬ 
sonnel  agree  on  the  ranking  of  the  criteria  and  therefore 
use  a  homogeneous  set  of  criteria. 
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Research  Question  1 


Can  the  airline  criteria,  if  they  exist,  he  legally 
applied  to  Air  Force  aircraft  acquisitions? 

Data  Collection  and  Analysis.  Because  of  the  chang¬ 
ing  nature  of  acquisition  law,  an  absolute  answer  to  this 
question  could  not  he  found.  This  is  because  interpreta¬ 
tions  of  laws  vary  among  experts  and  in  various  court  de¬ 
cisions  . 

Recognizing  this,  a  series  of  interviews  with  attor¬ 
neys  experienced  in  government  contract  law  were  conducted 
to  determine  if  they  felt  there  were  any  problems  in  em¬ 
ploying  the  airline  criteria.  Through  these  interviews,  an 
attempt  was  made  to  gather  a  list  of  potential  legal  problems. 

A  corollary  objective  in  these  interviews  was  to 
identify  the  specific  regulations  or  laws  which  prohibited 
implementation  of  these  criteria,  if  any. 

Research  Hypothesis  2 

Contracting  experts  in  the  Air  Force  agree  with  the 
commercial  airline  contracting  personnel  in  the  order  of  im¬ 
portance  of  the  criteria  used  in  evaluating  warranties. 

Data  Collection.  The  questionnaire  used  in  Research 
Hypothesis  1  was  again  used.  The  sampling  plan  was  to  iden¬ 
tify  a  list  of  experts  in  aircraft  acquisition  in  ASD.  Ex¬ 
perts  were  considered  to  be  Air  Force  contracting  officers 
presently  assigned  to  ASD  with  at  least  five  years  experience 
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in  Air  Force  aircraft  acquisition.  A  random  selection  using 
a  random  number  generator  was  made  of  a  list  of  experts  pro¬ 
vided  by  ASD/FMW  to  obtain  a  random  sample  of  the  expert 
contracting  officers  in  ASD. 

Identification/Definition  of  Variables.  In  collect¬ 
ing  data  for  testing  Research  Hypothesis  2,  fifteen  USAF  con¬ 
tracting  officers  were  asked  to  rank  order  the  list  of  cri¬ 
teria  used  in  evaluating  warranties  in  the  order  of  import¬ 
ance.  The  individual  criteria  used  in  evaluating  aircraft 
warranties  are  the  independent  variables  and  the  ordinal 
rankings  of  the  criteria  are  the  dependent  variables.  The 
questionnaire  letter  in  Appendix  C  contains  the  specific  in¬ 
structions  given  to  the  USAF  contracting  officers  and  a  list 
of  the  criteria  is  found  in  Appendix  D. 

Design  to  Test  Research  Hypothesis  2.  To  test  Re¬ 
search  Hypothesis  2,  two  statistical  tests  were  used.  First, 
the  Kendall  coefficient  of  concordance  W  was  used  to  deter¬ 
mine  if  the  rankings  given  to  the  criteria  by  the  USAF  con¬ 
tracting  officers  were  the  same.  If  the  USAF  contracting  of¬ 
ficers  agree  on  the  importance  of  the  criteria  used  in  evalu¬ 
ating  warranties,  then  a  comparison  can  be  made  between  the 
rankings  of  the  criteria  by  the  commercial  airline  contract¬ 
ing  personnel  and  the  rankings  of  the  criteria  by  the  USAF 
contracting  officers.  The  second  test  used  was  the  Spearman 
coefficient  of  correlation  r  .  This  test  was  used  to  compare 
the  rankings  of  the  criteria  by  commercial  airline  contract¬ 
ing  personnel  to  the  rankings  by  the  USAF  contracting  officers. 
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The  procedure  used  for  the  Kendall  W  test  was  the 

same  as  the  test  described  for  Research  Hypothesis  1.  The 

null  hypothesis  ( HQ )  for  this  test  is  the  rankings  given  to 

the  criteria  by  the  USAF  contracting  personnel  are  unrelated. 

The  alternate  hypothesis  (H^ )  is  the  rankings  given  to  the 

criteria  by  the  TJSAF  contracting  officers  are  related.  To 

continue  the  test  of  Research  Hypothesis  2,  the  results  of 

the  Kendall  W  test  must  be  to  reject  H  and  conclude  that 

o 

the  USAF  contracting  officers  agree  on  the  rankings  of  the 
criteria. 

To  evaluate  this  test  an  alpha  value  of  .05  was 
used.  Also,  since  the  sample  size  is  greater  than  seven,  a 
critical  chi-square  value  was  used  to  test  the  hypothesis 
(19:236) . 

The  Kendall  W  test  was  performed  using  the  following 

steps : 

1.  The  null  hypothesis  (Hq)  is  the  rankings  of  the 
criteria  by  the  USAF  contracting  officers  are  unrelated. 

The  alternate  hypothesis  (H^ )  is  the  rankings  given  to  cri¬ 
teria  by  the  USAF  contracting  officers  are  related. 

2.  An  alpha  value  of  .05  was  chosen  for  the  test. 

3.  The  rank  order  scores  were  placed  in  a  table 
having  N  columns  and  K  rows  (See  Appendix  H) . 

4.  The  Kendall  coefficient  of  concordance  W  was 
calculated  (See  Appendix  E) . 
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5-  A  chi-square  value  for  the  ranks  (X^g^g)  was 
calculated  using  the  following: 

*ranks  =  K<N-DW 

6.  The  Xp^^g  was  compared  against  the  critical 

2 

X  value  with  eleven  degrees  of  freedom  obtained  from  a  sta- 

O 

tistics  table.  If  the  XranjCs  is  greater  than  the  critical 
2 

X  ,  the  null  hypothesis  can  be  rejected  and  the  conclusion 
is  to  accept  the  alternate  hypothesis  (19:237). 

The  second  statistical  test  used  in  testing  Research 
Hypothesis  2  was  the  Spearman  rank  correlation  coefficient . 
This  test  can  be  used  on  ordinal  level  data  to  determine  if 
the  rank  order  of  two  samples  are  from  the  same  population 
(19: 202) . 

The  null  hypothesis  for  the  Spearman  test  is  the 
rankings  given  to  the  criteria  by  the  commercial  contracting 
officers  are  unrelated  to  the  rankings  given  to  the  criteria 
by  the  USAF  contracting  officers.  The  alternate  hypothesis 
is  the  commercial  contracting  officers  agree  with  USAF  con¬ 
tracting  officers  on  the  rankings  of  the  criteria. 

An  alpha  value  of  .05  was  selected  for  the  test  and 
because  the  number  of  criteria  was  greater  than  10  the  Stu¬ 
dent's  t  statistic  was  used  to  test  the  null  hypothesis  (19: 
212).  The  degrees  of  freedom  for  the  Student's  t  is  N-2 
(19:212) . 
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If  the  calculated  value  of  the  t  statistic  (t  )  is 
less  than  the  critical  value  of  the  t  statistic  then  the  null 
hypothesis  cannot  he  rejected.  If  t  is  greater  than  the 
critical  value  of  t  then  the  null  hypothesis  can  he  rejected 
and  the  conclusion  would  he  to  accept  the  alternate  hypo¬ 
thesis  . 

Criteria  Test.  The  criteria  test  for  Research  Hypo¬ 
thesis  2  addresses  the  question  of  the  agreement  between  the 
commercial  contracting  personnel  and  the  USAF  contracting 
officers  on  the  importance  of  the  criteria  used  in  evaluating 
aircraft  warranties.  If  the  Kendall  W  test  results  reject 
the  null  hypothesis  with  a  95 %  confidence  level,  then  the 
conclusion  is  the  USAF  contracting  personnel  give  the  crite¬ 
ria  the  same  level  of  importance.  If  the  Spearman  test  re¬ 
sults  reject  the  null  hypothesis,  then  the  conclusion  is  the 
commercial  airline  contracting  personnel  and  the  USAF  con¬ 
tracting  officers  give  each  criterion  the  same  level  of  im¬ 
portance.  If  this  conclusion  can  he  reached,  then  the  cri¬ 
teria  used  in  evaluating  commercial  aircraft  warranties  hy 
commercial  airline  contracting  personnel  have  the  same  level 
of  importance  as  the  criteria  used  hy  USAF  contracting  of¬ 
ficers  . 

Research  Question  2 

Can  a  list  of  criteria  he  developed  for  application 
of  commercial  aircraft  warranties  in  the  Department  of  De¬ 
fense? 
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Data  Collection  and  Analysis.  Using  the  criteria 
rankings  developed  in  Research  Hypotheses  1  and  2,  a  list  of 
criteria  in  order  of  importance  was  compiled.  The  list  was 
based  upon  the  results  of  Research  Hypothesis  1  and  the  re¬ 
sults  of  Research  Hypothesis  2.  The  list  was  presented  to 
Air  Force  contracting  experts  using  the  structured  interview 
technique.  Problems  in  the  applicability  of  these  criteria 
to  Air  Force  aircraft  acquisitions  were  then  listed  to  show 
which  of  the  criteria  are  not  applicable  to  Air  Force  acqui¬ 
sitions  and  why  these  criteria  are  not  applicable. 

Generalization 

The  findings  for  Research  Hypothesis  1  were  not 
generalized  beyond  the  population.  Similarly,  the  findings 
for  Research  Hypothesis  2  were  not  generalized  beyond  the 
population . 

Validity  of  Measurement 

Instruments 

As  mentioned  earlier,  the  measurement  instruments 
for  testing  Research  Hypotheses  1  and  2  were  evaluated  by 
experts  in  the  field  and  graduate  students  with  contracting 
experience.  Further,  the  statistical  tests  used  and  their 
applicability  to  the  research  were  coordinated  with  the 
statistics  department  of  Air  Force  Institute  of  Technology. 
Comments  concerning  the  validity  of  the  measurement  instru¬ 
ments  were  received,  and  the  measurement  instruments  were 
changed  as  necessary. 
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List  of  Assumptions 


1.  The  data  gathered  for  Research  Hypotheses  1  and 
2  were  independently  provided  by  the  respondents. 

2.  Any  criteria  omitted  in  the  study  had  no  sig¬ 
nificant  impact  on  the  research  results. 

3.  The  ordered  responses  supplied  by  the  respon¬ 
dents  reflect  the  actual  order  of  importance  of  the  criteria 
in  warranty  evaluations. 

4.  Interview  respondents  interpreted  the  wording  of 
the  criteria  in  the  same  manner. 

5.  For  the  nonparametric  statistical  tests,  the 
variables  were  assumed  to  have  underlying  continuity  (19:31). 

6 .  The  importance  of  the  criteria  given  by  the  air¬ 
line  chief  contracting  officers  reflect  the  order  of  impor¬ 
tance  placed  by  their  respective  airlines. 
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Chapter  3 


FINDINGS 


Overview 

This  chapter  is  a  presentation  of  the  results  of  the 
research  procedures  presented  in  Chapter  2  to  answer  the  re¬ 
search  hypotheses  and  questions  that  were  raised  in  the 
literature  review.  Nine  corollary  findings  are  also  pre¬ 
sented.  These  corollary  findings  are  a  result  of  additional 
information  which  was  uncovered  in  the  course  of  this  re¬ 
search  . 

Research  Hypothesis  1 

The  airlines  use  a  homogeneous  set  of  criteria  to 
evaluate  warranties. 

General .  To  evaluate  Research  Hypothesis  1,  phone 
interviews  were  conducted  with  all  ten  trunk  carrier  air¬ 
lines  to  obtain  a  list  of  criteria  used  by  the  commercial 
airline  contracting  personnel.  The  twelve  criteria  which 
were  obtained  are  listed  in  Appendix  D. 

A  random  sample  of  nine  trunk  carriers  were  then 
asked  to  rank  order  the  twelve  criteria  in  order  of  impor¬ 
tance.  If  the  commercial  airline  contracting  personnel 
agree  on  the  level  of  importance  of  the  criteria,  then  this 
would  support  the  hypothesis  that  the  airline  contracting 
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personnel  can  be  treated  as  a  homogeneous  group  in  terms  of 
evaluating  warranties.  The  nine  contracting  personnel  were 
asked  to  rank  order  the  list  of  criteria  assigning  a  one  to 
the  criterion  which  was  considered  most  important  and  a 
twelve  to  the  criterion  which  was  considered  least  important. 
The  rankings  obtained  from  the  airline  contracting  personnel 
are  listed  in  Appendix  G. 

Primary  finding.  The  statistical  test  used  to  test 
this  hypothesis  was  the  Kendall  Coefficient  of  Concordance  W. 
To  provide  additional  support  for  Research  Hypothesis  1,  the 
Friedman  Two-Way  Analysis  of  Variance  by  ranks  test  was  also 
used . 

The  null  hypothesis  for  these  tests  is  the  airline 
contracting  personnel  do  not  agree  on  the  rankings  of  the 
twelve  criteria.  The  alternate  hypothesis  is  the  airline 
contracting  personnel  agree  on  the  rankings  of  the  twelve 
criteria  and  therefore  represent  a  homogeneous  group. 

Kendall  coefficient  of  concordance  W:  To  perform 
the  Kendall  W  Test,  the  responses  from  the  nine  airline  con¬ 
tracting  personnel  were  entered  into  the  FORTRAN  computer 
program  listed  in  Appendix  N.  This  computer  program  cal¬ 
culates  the  Kendall  W  value  and  the  chi-square  value  as¬ 
sociated  with  this  calculated  Kendall  W  value.  If  more  than 
six  rankings  are  obtained  the  test  statistic  W  follows  a 
chi-square  distribution  with  degrees  of  freedom  equal  to 
the  number  of  criteria  minus  l(n-l)  (19:236). 
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The  value  obtained  for  the  Kendall  coefficient  of 
concordance  W  is  0.23992  and  the  associated  chi-square  value 
is  23.752.  Referring  to  the  table  of  critical  chi-square 
values,  it  was  found  that  a  chi-square  value  of  23.752  with 
eleven  degrees  of  freedom  has  a  probability  of  occurring  of 
0.02  (19:249).  Since  the  probability  of  occurrence  (0.02)  is 
less  than  the  alpha  value  (0.05),  the  conclusion  is  to  re¬ 
ject  the  null  hypothesis  and  accept  the  alternate  hypothesis 
that  the  airline  contracting  personnel  represent  a  homogene¬ 
ous  group  in  ranking  the  twelve  criteria. 

Friedman  Two-Way  Analysis  of  Variance  by  Ranks  Test: 
The  Friedman  Two-Way  Analysis  of  Variance  (AN0VA)  by  ranks 
test  can  be  used  for  testing  whether  a  number  of  samples 
have  been  drawn  from  the  same  population  (19:1 66).  In 
testing  Research  Hypothesis  1,  this  test  is  used  to  determine 
if  the  rankings  given  to  the  twelve  criteria  by  the  nine  air¬ 
line  contracting  personnel  were  randomly  assigned. 

The  null  hypothesis  (Hq)  for  the  Friedman  AN0VA  is 
the  rankings  assigned  to  the  twelve  criteria  by  the  nine 
airline  contracting  personnel  were  random.  The  alternate 
hypothesis  (H^)  is  the  rankings  are  not  random  and  there 
exist  agreement  on  the  rankings  of  the  twelve  criteria  by 
the  airline  contracting  personnel.  If  this  test  shows  that 
the  null  hypothesis  can  be  rejected,  then  the  acceptance  of 
the  alternate  hypothesis  would  support  the  finding  that  the 
airline  contracting  personnel  are  a  homogeneous  group  in 
their  ranking  of  the  twelve  criteria. 
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An  alpha  value  of  0.05  was  selected  to  test  the  sig¬ 
nificance  of  the  Friedman  Two-Way  ANOVA. 

The  Statistical  Package  for  the  Social  Sciences 
(SPSS)  system  of  computer  programs  was  used  to  test  this 
hypothesis.  Sub-program  NPAR  TESTS  was  used  and  the  rank¬ 
ings  of  the  criteria  were  entered  (See  Appendix  L) .  The 
output  from  the  program  showed  a  chi-square  value  23-752  and 
a  significance  level  of  0.014.  Since  the  level  of  signifi¬ 
cance  from  the  test  ( 0.014)  is  less  than  the  alpha  value 
(0.05) »  the  conclusion  is  to  reject  the  null  hypothesis  and 
accept  the  alternate  hypothesis  that  the  airline  contracting 
personnel  agree  on  the  rankings  of  twelve  criteria  in  order 
of  importance  and  therefore  represent  a  homogeneous  group. 

Research  Question  1 

Can  the  airline  criteria,  if  they  exist,  be  legally 
applied  to  Air  Force  aircraft  acquisitions? 

Interview  Results.  Interviews  were  conducted  with 
two  attorneys  from  the  Procurement  Opinion  Division  of  AFLC 
and  with  an  attorney  who  presently  teaches  contract  law  at 
the  Air  Force  Institute  of  Technology  to  determine  if  there 
are  any  legal  impedements  to  government  officials  using  the 
criteria  developed  through  interviews  with  the  airline  ex¬ 
perts.  All  three  lawyers  indicated  that  no  laws  or  regula¬ 
tions  would  be  violated  by  using  any  or  all  of  these  cri¬ 
teria  to  evaluate  a  warranty.  Therefore,  the  answer  to  this 
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research  question  is  that  at  present  there  is  no  known  legal 
restriction  to  the  use  of  these  criteria  in  government  negoti 
ation  in  evaluating  an  aircraft  warranty. 

Research  Hypothesis  2 

Contracting  experts  in  the  Air  Force  agree  with  the 
commercial  airline  contracting  personnel  in  the  order  of  im¬ 
portance  of  the  criteria  used  in  evaluating  warranties. 

First  Primary  Finding.  Research  Hypothesis  2  was 
evaluated  using  two  procedures.  First,  nine  ASD  contracting 
experts  were  asked  to  rank  order  the  twelve  criteria  obtained 
from  the  commercial  airline  contracting  personnel.  These 
ranks  were  then  tested  using  the  Kendall  coefficient  of  con¬ 
cordance  test  to  ascertain  whether  the  ASD  contracting  ex¬ 
perts  could  he  considered  a  homogeneous  group.  If  the  ASD 
contracting  experts  are  a  homogeneous  group  in  ranking  the 
criteria,  then  the  second  procedure  is  to  compare  the  rank¬ 
ings  from  the  ASD  experts  with  the  rankings  of  commercial  air 
line  contracting  personnel  to  determine  if  the  rankings  show 
agreement .  This  comparison  would  he  done  using  a  Spearman 
rank  correlation  coefficient.  If  agreement  is  found  to  exist 
then  the  order  of  importance  of  the  criteria  is  the  same  for 
the  ASD  contracting  experts  and  the  commercial  airline  con¬ 
tracting  personnel. 

The  first  procedure  used  in  Research  Hypothesis  2  is 
to  determine  if  the  nine  ASD  contracting  officers  represent 


38 


a  homogeneous  group.  The  statistical  test  used  in  this  pro¬ 
cedure  is  the  Kendall  coefficient  of  concordance  test.  To 
support  this  result  the  Friedman  Two-Way  ANOVA  was  also  used. 
The  null  hypothesis  for  these  tests  is  that  the  nine  ASD 
contracting  officers  do  not  agree  on  the  rankings  of  the 
twelve  criteria  used  in  evaluating  an  aircraft  warranty. 

The  alternate  hypothesis  is  that  the  ASD  contracting  offi¬ 
cers  agree  on  the  rankings  of  the  criteria  and  therefore 
constitute  a  homogeneous  group  in  ranking  the  criteria. 

Kendall  Coefficient  of  Concordance:  To  test  the 
hypothesis  that  the  nine  ASD  contracting  officers  agree  on 
the  rankings  of  the  twelve  criteria,  the  ranks  obtained  for 
the  criteria  were  entered  into  the  FORTRAN  program  listed  in 
Appendix  N.  The  results  from  the  FORTRAN  program  are  a 
Kendall  coefficient  of  concordance  W  equal  to  0. 38565  and 
the  associated  chi-square  value  equal  to  38. 18.  The  critical 
chi-square  value  with  eleven  degrees  of  freedom  and  a  sig¬ 
nificance  level  of  0.05  is  19-68  (19:249).  If  the  calcu¬ 
lated  chi-square  value  is  less  than  or  equal  to  the  critical 
chi-square  value  then  the  decision  would  he  to  accept  the 
null  hypothesis  that  there  is  no  agreement  of  the  rankings 
of  the  criteria  by  the  ASD  contracting  officers.  Since  the 
results  of  this  test  show  a  calculated  chi-square  value 
(38-18)  greater  than  the  critical  chi-square  value  (19.68), 
the  decision  is  to  reject  the  null  hypothesis  and  accept 
the  alternate  hypothesis  that  the  ASD  contracting  officers 
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agree  on  the  rankings  of  the  criteria  and  represent  a  homog¬ 
eneous  group  in  ranking  the  criteria  in  the  order  of  impor¬ 
tance  . 

Friedman  Two-Way  ANOVAs  The  Friedman  Two-Way  ANOVA 
was  used  to  support  the  results  obtained  from  the  Kendall  co¬ 
efficient  of  concordance  test. 

The  null  hypothesis  is  there  is  no  agreement  be¬ 
tween  the  nine  ASD  contracting  officers  on  the  rankings  of 
the  twelve  criteria.  The  alternate  hypothesis  is  the  ASD 
contracting  officers  agree  on  the  rankings  of  the  twelve 
criteria.  An  alpha  value  of  0.05  was  selected  to  test  this 
hypothesis . 

The  rankings  obtained  from  the  ASD  contracting  of¬ 
ficers  for  the  criteria  were  entered  into  the  SPSS  sub¬ 
program  NPAR  TESTS.  The  output  from  this  program  showed  a 
chi-square  value  of  38.179  and  a  significance  level  of  0.000. 
Since  the  significance  level  obtained  from  rankings  of  the 
ASD  contracting  officers  ( 0.000)  is  less  than  the  alpha 
value  (0.05) »  the  conclusion  is  to  reject  the  null  hypo¬ 
thesis  and  accept  the  alternate  hypothesis  that  the  nine  ASD 
contracting  officers  agree  on  the  rankings  of  the  twelve 
criteria.  Therefore  the  ASD  contracting  officers  represent 
a  homogeneous  group  in  ranking  the  twelve  criteria. 

Second  Primary  Finding.  Since  the  results  from  the 
first  procedure  show  that  the  ASD  contracting  officers  are  a 
homogeneous  group  in  ranking  the  criteria,  the  second 
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procedure  is  to  compare  the  rankings  obtained  from  the  com¬ 
mercial  airline  contracting  personnel  with  the  rankings  ob¬ 
tained  from  the  ASD  contracting  experts.  This  test  was  con¬ 
ducted  using  the  Spearman  rank  correlation  coefficient. 

Also,  to  support  this  finding,  the  Kendall  rank  correlation 
coefficient  was  used.  The  null  hypothesis  for  these  two 
tests  is  the  ASD  contracting  officers  disagree  with  the 
rankings  of  the  criteria  by  the  airline  contracting  person¬ 
nel.  The  alternate  hypothesis  is  the  ASD  contracting  of¬ 
ficers  agree  with  the  rankings  of  the  criteria  by  the  air¬ 
line  contracting  personnel.  The  alpha  value  for  these  tests 
was  set  at  0.05« 

Spearman  Rank  Correlation  Coefficient:  To  conduct 
the  Spearman  rank  correlation  coefficient  test,  the  twelve 
criteria  obtained  from  the  commercial  airline  contracting 
personnel  were  ranked  from  one  to  twelve  using  the  mean 
ranks  of  each  criterion  (See  Appendix  J) .  The  same  proce¬ 
dure  was  used  to  rank  the  criteria  from  the  ASD  contracting 
officers  (See  Appendix  K)  . 

The  rankings  were  input  into  the  SPSS  sub -program 
NPAR  CORR  (See  Appendix  M) .  This  sub-program  calculated  the 
Spearman  rank  correlation  coefficient  and  the  associated 
probability.  The  output  from  the  SPSS  program  showed  a 
Spearman  rank  correlation  coefficient  of  0.3678  and  an  as¬ 
sociated  probability  of  0.120.  Because  the  calculated  pro¬ 
bability  (0.120)  is  greater  than  the  alpha  value  (0.05)  set 


for  this  test,  the  conclusion  is  to  not  reject  null  hypo¬ 
thesis  that  the  ASD  contracting  experts  do  not  agree  with 
commercial  airline  contracting  personnel  in  the  order  of 
importance  of  the  twelve  criteria. 

Kendall  Rank  Correlation  Coefficient:  The  Kendall 
rank  correlation  coefficient  Tau  was  used  to  support  the 
findings  from  the  Spearman  rank  correlation  coefficient. 

The  Kendall  Tau  will  give  a  measure  of  the  degree  of  correla¬ 
tion  between  two  sets  of  ranks  (16:214). 

To  conduct  the  Kendall  Tau  test  the  mean  ranks  were 
input  into  SPSS  sub-program  NPAR  CORR.  This  sub-program  cal¬ 
culates  the  Kendall  Tau  value  and  its  associated  probability. 
The  output  from  the  SPSS  program  showed  a  Kendall  Tau  value 
of  0.3512  and  an  associated  probability  of  0.057-  Because 
the  calculated  probability  (0.057)  is  greater  than  the  alpha 
value  (0.05) »  the  conclusion  is  to  not  reject  the  null  hypo¬ 
thesis  that  ASD  contracting  experts  do  not  agree  with  the 
commercial  airline  contracting  personnel  on  the  order  of 
importance  of  the  twelve  criteria. 

Research  Question  2 

Can  a  list  of  criteria  be  developed  for  application 
of  commercial  aircraft  warranties  in  the  Department  of 
Defense? 

Interview  Results.  In  order  to  evaluate  Research 
Question  2,  the  list  of  airline  criteria  was  given  to  the 
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ASD  experts  who  had  ranked  them.  These  experts  were  then 
asked  if  there  were  any  reasons  these  criteria  could  not  be 
used  in  ASD  procurements. 

Responses  varied  widely.  Five  of  the  ASD  respondents 
saw  no  reason  why  the  criteria  cannot  be  used,  the  others 
voiced  reservations  on  the  applicability  of  the  criteria, 
two  of  these  voiced  reservations  on  more  than  two  criteria. 
Most  emphasized  the  difference  between  the  types  of  equip¬ 
ment  purchased  by  the  Air  Force  and  the  airlines.  This 
point  was  summed  up  by  David  Vicars,  a  contracting  officer  in 
the  Maverick  System  Program  Office  (SPO): 

I  suspect  that  you  will  find  that  warranties 
in  a  commercial  environment  will  vary  from  the 
government  in  many  ways.  Commercial  carriers  are 
usually  buying  "off  the  shelf"  aircraft  that  have 
already  been  developed  while  the  government  is 
seeking  to  develop,  through  R&D,  a  new  product. 

Therefore,  the  risks  would  be  perceived  from  a  dif¬ 
ferent  point  of  view  on  these  environments  which, 
of  course,  is  reflected  in  the  warranty  priorities 
[24]. 

Pete  Gagaris,  a  contracting  officer  in  the  Propul¬ 
sion  SPO,  voiced  similar  reservations.  He  also  pointed  out 
that  besides  this  difference,  the  Air  Force  emphasizes  the 
quality  of  the  equipment  rather  than  coverage  of  it.  He 
stated  his  belief  that  due  to  the  fact  that  military  air¬ 
craft  are  on  the  leading  edge  of  technology,  it  is  in  the 
government’s  best  interests  to  be  self-insured  (6). 

In  looking  at  the  specific  criteria,  the  most  com¬ 
ments  related  to  the  ASD  respondents '  most  important 
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criterion:  the  cost  effectiveness  of  the  warranty.  Ironi¬ 
cally,  several  questioned  whether  or  not  it  is  possible  to 
quantify  cost  even  though  they  consider  it  to  be  the  most 
important  criterion.  They  explained  this  discrepancy  by 
the  fact  that  cost  breakout  data  is  important  to  get  any 
contract  price  approved  in  AFSC. 

Further,  Mr.  Robert  Kinderman,  a  Contracting  Officer 
in  ASD,  pointed  out  that  actually  breaking  out  the  cost  of 
the  warranty  is  difficult.  At  the  same  time  he  said,  "cost 
is  not  easy  to  prove,  but  philosophically,  I  want  to  get 
one  (warranty)  when  someone  will  guarantee  the  product 
[11].  " 

Mr.  Gagaris,  Mr.  Kinderman  and  Mr.  Miller  stated 
reservations  on  criterion  E,  the  right  to  repair  parts  for 
reimbursement.  All  three  doubted  that  this  was  applicable 
to  Air  Force  acquisitions  as  Mr.  Gagaris  put  it,  "getting 
money  back  is  not  necessarily  good  [6]."  Mr.  Gagaris  pointed 
out  that  such  provisions  as  the  right  to  repair  parts  for 
reimbursement  could  be  difficult  to  enforce  because  of  the 
fact  that  Air  Force  maintenance  personnel  are  not  certified 
by  the  Federal  Aviation  Administration  (6). 

Mr.  Gagaris  also  stated  reservations  on  the  criterion 
dealing  with  greater  coverage  due  to  a  new  design,  pointing 
out  that  it  would  often  be  inconsistent  with  our  purchasing 
methods  because  "configuration  is  controlled  by  the  Air 

Force  in  aircraft  acquisitions  whereas  the  contractor  con¬ 
trols  it  in  the  commercial  arena  [6]." 
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In  discussing  criterion  J,  the  right  to  make  or  buy 
parts  from  others  for  reimbursement  if  the  seller  cannot 
supply  them,  both  Mr.  Miller  and  Mr.  Kinderman  expressed 
doubts .  Both  felt  the  government  would  be  reluctant  to 
charge  contractors  on  a  part  because  of  time  and  also  due  to 
the  complicating  factor  of  collateral  damage  if  the  re¬ 
placed  part  fails  damaging  other  warranted  items.  Mr. 
Kinderman  also  emphasized  that  this  relates  to  a  basic  re¬ 
quirement  of  any  purchase,  an  adequate  pipeline  of  parts 
must  be  available.  Without  this,  a  warranty  is  meaningless 
and  will  be  broken  in  order  to  repair  or  replace  a  part  to 
keep  the  aircraft  flying  (ll). 

Finally,  our  respondents  were  asked  if  any  criteria 
appeared  to  be  missing  in  the  list  provided.  Mr.  Kinderman 
was  the  only  respondent  to  offer  a  criterion  which  he  felt 
should  be  included  in  evaluating  a  warranty.  He  stated  it 
this  way:  "keep  it  simple,  the  shorter  the  better  [11]." 

Primary  Findings ■  While  a  list  of  criteria  can  be 
developed  for  application  of  commercial  aircraft  warranties, 
it  should  be  emphasized  that  the  criteria,  like  the  war¬ 
ranties,  cannot  be  applied  in  every  instance.  Yet  a  gener¬ 
alized  list  was  developed,  in  order  of  importance,  for  ap¬ 
plication  in  DOD  acquisition.  This  list  (See  Figure  5)  is 
the  criteria  in  order  of  importance  as  developed  through  the 
responses  of  the  airline  experts  and  the  statistical  tech¬ 
niques  used  in  Research  Hypothesis  1 .  Based  on  the 
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Rank  by  Airlines 


Commercial  Airline  Criteria  Applicable 

1  F  The  warranty  guarantees  that  the  seller  will  rede¬ 

sign  and  replace  components  if  they  fail  with  ex¬ 
ceptional  frequency. 

2  A  The  length  of  coverage  on  aircraft  components,  meas¬ 

ured  by  Mean  Time  Between  Failure  (MTBF) 

2  B  The  past  performance  of  the  seller  on  warranties  * 

4  H  The  scope  of  coverage  should  be  increased  to  include 

components  which  historically  have  problems 

6  C  The  coverage  on  particular  components  is  in  the  most 

appropriate  unit  of  measure,  that  is  in  hours  or 
months  or  cycles. 

7  D  The  reliability  of  the  same  or  similar  components 

presently  in  service 


9.  I  The  past  performance  of  the  aircraft  series 
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The  coverage  on  the  aircraft  offered  by  the  manufac¬ 
turer  compared  to  that  offered  by  others. 

The  warranty  is  cost  effective,  that  is,  the  cost  of 
the  warranty  is  less  than  the  savings  realized  with 
the  warranty  * 

Criteria  Not  Applicable 

The  warranty  permits  us  to  repair  parts  for  reim¬ 
bursement  * 


G  The  coverage  of  a  new  design  should  be  greater  due 
to  greater  risk 

J  The  right  to  make  or  buy  parts  from  others  for  reim¬ 
bursement  if  the  seller  cannot  supply  them 


*  Denotes  criterion  which  was  ranked  by  greater  than  five 
places  apart  by  airline  and  ASD  experts. 


Figure  5  Commercial  Airline  Criteria  Applicable  and 

Not  Applicable  to  Air  Force  Aircraft  Acquisitions 
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explanation  of  ASD  experts  as  to  why  certain  criteria  should 
not  apply  to  DOD  acquisitions,  those  criteria,  which  are  not 
applicable,  in  the  researchers’  judgment  are  found  at  the 
end  of  Figure  5*  To  aid  the  reader  in  isolating  those  rank¬ 
ings  which  significantly  differ  between  commercial  airline 
practices  and  the  evaluations  of  DOD  experts,  those  criteria 
which  are  ranked  more  than  five  places  apart  by  these  groups 
are  followed  by  an  asterisk. 

Although,  as  mentioned  earlier,  considerable  dis¬ 
agreement  exists  on  the  cost  effectiveness  of  warranties 
and  the  ability  to  measure  it,  this  criterion  is  used  to 
some  degree  by  the  airlines  and  was  considered  the  most  im¬ 
portant  criterion  by  the  ASD  experts  in  spite  of  their  re¬ 
servations  on  the  capability  to  measure  it.  For  these  rea¬ 
sons,  the  researchers  left  this  criterion  on  the  list  but 
also  pointed  out  that  it  is  the  least  important  of  the  air¬ 
line  criteria  applicable  to  DOD  procurements.  Further  dis¬ 
cussion  on  this  criterion  can  be  found  in  this  chapter  under 
the  heading  Corollary  Finding  5* 

Summary  of  Primary  Findings 

Twelve  criteria  were  obtained  from  the  commercial 
airline  contracting  personnel.  The  results  of  Research 
Hypothesis  1  showed  that  the  nine  commercial  airline  con¬ 
tracting  personnel  agree  on  the  order  of  importance  of  the 
twelve  criteria  used  in  evaluating  warranties.  A  survey  of 
lawyers  showed  the  twelve  criteria  could  be  legally  applied 
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in  evaluating  warranties  in  the  DOD  environment.  Nine  ASD 
contracting  experts  also  ranked  the  twelve  criteria  and 
agreement  was  also  found  within  the  ASD  contracting  experts 
in  the  order  of  importance  of  the  twelve  criteria.  However, 
the  ASD  contracting  expert's  rankings  of  the  twelve  criteria 
did  not  agree  with  the  rankings  from  the  commercial  airline 
contracting  personnel.  A  list  of  criteria  was  developed  for 
use  in  evaluating  warranties  "based  on  the  rankings  from  the 
commercial  airline  contracting  personnel  and  interviews  with 
ASD  contracting  experts. 

Corollary  Findings 

The  corollary  findings  are  a  result  of  new  informa¬ 
tion  surfaced  in  interviews  and  as  a  result  of  the  data  re¬ 
ceived  on  the  questionnaire. 

In  conducting  interviews  with  airline  contracting 
experts,  questions  surfaced  whose  answers  might  have  an 
impact  on  the  validity  of  the  findings  related  to  the  cri- 

These  questions  are  reflected  in  the  four  questions 
found  at  the  "bottom  of  the  questionnaire  (See  Appendix  D)  . 

In  the  first  three  questions,  a  Likert  scale  was  used.  A 
t-test  is  presented  in  each  corollary  finding  concerning 
these  questions.  The  t-test  assumes  interval  level  data. 

The  i/Iann -Whitney  U  test,  using  SPSS,  was  also  performed  in 
each  test  involving  these  questions,  although  the  results  are 
not  presented  herein.  The  results  of  the  Mann-Whitney  TJ 
test  which  is  a  nonparametric  test  requiring  only  ordinal 
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level  data,  were  the  same  as  the  t-test  results  in  every 
case.  The  last  question  was  simply  a  yes/no  answer,  there¬ 
fore,  the  data  was  treated  as  nominal  and  no  statistical 
tests  were  done.  Corollary  findings  6  through  9  compared  the 
perception  of  Air  Force  experts  of  commercial  practices  of 
the  airlines  with  the  airlines  actual  responses. 

Corollary  Finding  1 .  This  question  arose  in  inter¬ 
viewing  the  trunk  carrier  experts,  some  of  whom  expressed 
the  belief  that  there  might  he  a  difference  between  the  larger 
and  smaller  trunk  carriers  in  the  way  they  approach  war¬ 
ranties.  Some  hypothesized  that  the  smaller  carriers  tended 
to  go  along  with  the  warranties  already  achieved  by  the 
larger  carriers  in  aircraft  purchase  negotiations.  If  true, 
this  would  mean  the  criteria  supplied  by  the  smaller  air¬ 
lines  are  rarely,  if  ever,  used.  Therefore,  the  criteria 
supplied  by  the  larger  trunk  carriers  would  be  far  more  im¬ 
portant  because  they  had  stood  the  test  of  actual  use.  This 
view  is  consistent  with  a  common  belief  that  the  contractors 
are  reluctant  to  change  coverage  on  an  item  because  they  at¬ 
tempt  to  standardize  their  coverage  between  carriers  to  make 
their  service  program  easier  to  administer. 

In  order  to  determine  the  validity  of  the  belief, 
that  the  smaller  airlines  consider  the  warranty  less  nego¬ 
tiable,  the  following  question  was  included  in  the  question¬ 
naire  (See  Appendix  D): 
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The  aircraft  warranty  is  treated  as  a  negotiable 
item  by  your  airline  . 

The  t-test  was  performed  using  the  following  steps: 

1 .  The  following  hypotheses  were  used  to  evaluate 
the  data: 

Hq:  The  larger  trunk  carriers  consider  the  warranty 
as  negotiable  as  the  smaller  trunk  carriers  do. 

H^:  The  larger  trunk  carriers  do  not  consider  the 
warranty  as  negotiable  as  the  small  trunks . 

2.  An  alpha  value  of  .05  was  chosen. 

3.  The  trunk  carriers  were  divided  into  two  groups 
based  upon  total  operating  revenue  and  passengers  (21:74). 

The  larger  four  carriers  were  considered  the  larger  trunks. 

4.  The  test  was  conducted  (See  Appendix  0). 

5.  The  test  resulted  in  a  t  of  .986  and  a  t'  with 
N-2  degrees  of  freedom  at  alpha  of  .05  of  2.365.  Therefore 
the  null  hypothesis  that  the  larger  trunk  carriers  and  the 
smaller  trunk  carriers  consider  the  warranty  as  negotiable 
was  not  rejected.  The  results  of  the  test  indicate  that  the 
smaller  trunk  carriers  do  consider  the  warranty  as  negotiable 
as  the  larger  trunk  carriers  do. 

Corollary  Finding  2.  The  same  test  as  the  one  used 
in  Corollary  Finding  1  was  used  to  determine  if  the  ASD  ex¬ 
perts  consider  the  warranty  as  a  negotiable  item  as  much  as 
the  airline  experts  do . 

1.  Therefore,  the  following  hypotheses  were  used: 
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Hq:  The  ASD  experts  consider  the  warranty  to  he  as 
negotiable  as  the  airline  experts  do. 

H^:  The  ASD  experts  consider  the  warranty  to  be  more 
or  less  negotiable  than  the  airline  experts  do. 

2.  An  alpha  value  of  .05  was  chosen. 

3.  The  test  was  conducted  in  the  same  manner,  using 
the  same  formulas  as  found  in  Appendix  0  where  the  computa¬ 
tions  for  this  corollary  finding  are  shown. 

4.  The  test  resulted  in  a  t  of  1.25335  and  a  t'  with 
N-2  (16)  degrees  of  freedom  at  alpha  of  .05  to  be  2.120. 
Therefore,  the  null  hypothesis  that  the  ASD  experts  consider 
the  warranty  to  be  as  negotiable  as  the  airline  experts  do 
was  not  rejected. 

Corollary  Finding  3.  Again,  the  same  test  of  dif¬ 
ference  between  means  shown  for  Corollary  Finding  2  (See  Ap¬ 
pendix  0)  was  used.  The  question  was  whether  or  not  there 
was  a  difference  between  the  airline  and  ASD  view  of  the  cost 
effectiveness  of  the  warranty. 

1 .  The  following  hypotheses  were  used: 

Hq :  The  airline  experts  and  ASD  experts  view  the 
benefits  of  the  warranty  as  compared  to  the  price  in  the 
same  way. 

H> :  The  airline  experts  and  ASD  experts  do  not  view 
the  benefits  of  the  warranty  as  compared  to  the  costs  in  the 
same  way. 

2.  An  alpha  value  of  .05  was  chosen. 
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3.  The  test  was  conducted  in  the  same  manner,  using 
the  same  formulas  found  in  Appendix  0  where  the  computations 
for  Corollary  Finding  2  are  shown. 

4.  The  test  resulted  in  a  t  of  1.097  and  a  t'  with 
N-2  ( 1 6 )  degrees  of  freedom,  of  2.120.  Therefore  the  null 
hypothesis  was  not  rejected.  The  ASD  experts  and  the  airline 
experts  considered  the  relationship  between  warranty  costs 
and  benefits  in  roughly  the  same  manner. 

Corollary  Finding  4.  The  same  test  as  the  one  used 
in  Corollary  Findings  1  through  3  was  again  used  to  determine 
if  the  ASD  experts  and  the  airline  experts  agreed  on  whether 
proposal  leveling  was  the  most  effective  way  of  getting  the 
best  coverage  on  an  aircraft  warranty. 

1.  The  following  hypotheses  were  used: 

Hq:  The  airline  and  ASD  experts  agree  that  proposal 
leveling  is  the  most  effective  way  of  getting  the  best  cover¬ 
age  on  an  aircraft  warranty. 

:  The  airline  and  ASD  experts  do  not  agree. 

2.  An  alpha  value  of  .05  was  used. 

3*  The  test  was  conducted  using  the  same  formulas 
found  in  Appendix  0  where  the  computations  for  Corollary 
Finding  2  are  shown. 

4.  The  test  resulted  in  a  t  of  .978  and  at'  of 
2.12.  Therefore,  once  again  the  null  hypothesis  could  not 
be  rejected.  Therefore,  the  ASD  experts  and  the  airline  ex¬ 
perts  do  not  disagree  on  the  value  of  proposal  leveling, 
with  95$  confidence. 
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Corollary  Finding  5 •  This  finding  concerns  the  use 
of  proposal  leveling  in  the  airlines  and  ASD.  Three  points 
are  salient  in  this  issue.  They  are  the  results  from  our 
question  asking  the  airline  and  ASD  experts  if  they  use 
proposal  leveling  and  finally  the  ASD  experts'  opinions  on 
whether  or  not  the  airlines  do  in  fact  use  this  practice. 

All  nine  of  the  airline  contracting  experts  who  were 
sent  a  questionnaire  answered  the  question  no,  that  they  do 
not  use  proposal  leveling.  In  addition,  several  included 
comments  that  such  practices  are  unethical  and  against 
company  policy.  One  expert  stated  an  opinion  that  the 
practice  may  be  illegal  for  commercial  companies.  One 
photocopied  questionnaire  was  received  from  a  warranty  ad¬ 
ministrator  for  an  airline  (In  all,  two  photocopied  ques¬ 
tionnaires  were  received  from  individuals  who  were  not  asked 
to  fill  them  out  by  the  researchers.  Their  responses  were 
not  included  in  the  primary  findings).  This  administrator 
answered  the  question  yes. 

Of  the  nine  ASD  experts  who  responded  to  the  ques¬ 
tionnaire,  all  but  one  said  they  did  not  use  proposal 
leveling . 

As  explained  in  Corollary  Finding  6,  nine  Air  Force 
experts  were  asked  to  give  their  perceptions  of  the  airline 
practices  by  answering  the  questionnaire  on  the  basis  of  how 
they  feel  the  airlines  do  business.  Of  these,  six  felt  the 
airline  do  use  proposal  leveling  and  three  felt  the  airlines 
do  not  use  proposal  leveling. 
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Greater  insight  into  the  question  of  the  Air  Force 
experts'  perception  of  the  airlines'  use  of  proposal  leveling 
was  offered  hy  Lt.  Col.  Pattison,  one  of  the  attorneys  from 
the  Procurement  Opinion  Division  who  was  interviewed.  Lt. 
Colonel  Pattison  stated  his  belief  that  the  airline  experts, 
especially  at  higher  corporate  levels  would  he  reluctant  to 
admit  the  use  of  this  technique,  even  though  it  isn't  illegal 
for  them  to  use  it,  because  it  is  probably  against  corporate 
policy .  He  felt  that  the  negotiators  in  the  airlines  prob¬ 
ably  do  use  it.  At  the  same  time,  he  stated  that  the  ASD 
experts  probably  would  claim  that  they  do  not  use  it  because 
it  is  against  the  DAR  although  the  technique  is  sometimes 
used  by  Government  engineers  during  a  negotiation  (17). 

A  clear  majority  of  airline  and  ASD  experts  re¬ 
sponded  that  they  did  not  use  proposal  leveling.  Further, 
there  is  a  belief  among  a  majority  of  Air  Force  experts 
questioned  that  the  airlines  do  use  proposal  leveling. 

Corollary  Finding  6 .  To  determine  if  the  ASD  con¬ 
tracting  experts  have  an  accurate  perception  of  the  airline 
procedures  used  in  evaluating  warranties,  another  sample  was 
taken.  Nine  Air  Force  personnel  were  asked  to  rank  order 
the  twelve  criteria  in  the  order  of  importance  they  believe 
the  commercial  airlines  would  use.  Two  of  nine  original  re¬ 
spondents  were  replaced  for  this  test  because  two  of  the 
original  experts  were  unavailable.  These  rankings  were  then 
tested  for  agreement  to  determine  if  the  DOD  contracting 
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personnel  were  a  homogeneous  group  in  their  perception  of  the 
commercial  airline  experts  evaluation  of  warranties.  This 
test  was  conducted  using  the  Kendall  coefficient  of  concord¬ 
ance  W.  The  null  hypothesis  for  this  test  is  the  nine  Air 
Force  experts'  perceptions  of  the  airline  ranking  of  the  cri¬ 
teria  do  not  agree.  The  alternate  hypothesis  for  this  test 
is  the  nine  Air  Force  experts  agree  on  the  rankings  and 
therefore  represent  a  homogeneous  group  in  their  perception 
of  the  airline's  ranking  of  the  twelve  criteria.  This  test 
was  conducted  with  an  alpha  value  of  0.05- 

Kendall  Coefficient  of  Concordance  W:  The  rankings 
of  the  criteria  obtained  from  the  nine  Air  Force  experts 
based  on  their  perception  of  airline  rankings  were  input  in¬ 
to  the  Kendall  W  computer  program  (See  Appendix  N) .  The 
output  from  the  program  showed  a  Kendall  W  value  of  0.17224 
and  an  associated  chi-square  value  of  17 .05-  The  critical 
chi-square  with  eleven  degrees  of  freedom  and  a  significance 
level  of  0.05  is  19-68  (19:249).  Since  the  calculated  chi- 
square  value  (17-05)  is  less  than  the  critical  chi-square 
value  (19-68),  the  null  hypothesis  that  the  Air  Force  experts 
do  not  agree  on  their  perception  of  the  airline's  rankings 
can  not  be  rejected.  Therefore,  the  results  of  this  test 
shows  that  the  nine  Air  Force  experts  are  not  a  homogeneous 
group  in  their  perception  of  the  commercial  airline's  rank¬ 
ings  of  the  twelve  criteria. 
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Corollary  Finding  7  ■  The  test  "between  means  used  in 


Corollary  Findings  1  through  4  was  again  used.  This  time  a 
comparison  "between  the  means  of  the  responses  made  "by  the 
airline  experts  and  the  Air  Force  experts'  perceptions  of 
their  responses  were  made  on  the  following  question. 

The  aircraft  warranty  is  treated  as  a  negotiable 
item  "by  your  airline. 

1.  The  following  hypotheses  were  evaluated: 

Hq:  The  airline  experts'  view  and  the  Air  Force  ex¬ 
perts'  perception  of  that  view  on  the  above  question  are  the 
same . 

:  The  airline  experts'  view  and  the  Air  Force  ex¬ 
perts’  perception  of  that  view  on  this  question  are  not  the 
same . 

2.  An  alpha  value  of  .05  was  chosen. 

3-  The  test  was  conducted  in  the  same  manner,  using 
the  same  formulas  found  in  Appendix  0,  where  the  computa¬ 
tions  for  Corollary  Finding  2  are  shown. 

4.  At  value  of  1.397  was  calculated  and  at'  of 
2.12.  Since  the  t’  is  greater  than  the  calculated  t  the 
null  could  not  be  rejected. 

Corollary  Finding  8.  The  test  between  means  des¬ 
cribed  above,  using  the  same  steps  and  formulas  was  performed 
with  an  alpha  value  of  .05*  This  test  was  used  to  determine 
if  the  airline  experts'  opinions  and  the  perception  of  those 
opinions  held  by  the  Air  Force  experts  are  in  agreement  on 
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whether  or  not  the  price  of  a  warranty  is  more  than  offset 
by  the  benefits  of  the  coverage.  The  same  hypotheses  as 
shown  in  Corollary  Finding  7  were  used. 

The  results  shown  in  Appendix  0  included  a  calculated 
t  of  1.46  which  was  less  than  the  t'  of  2.12  which  was  needed 
to  reject  the  null.  Therefore  the  null  that  there  was  no 
difference  between  the  airline  experts'  opinions  and  the  Air 
Force  experts'  perception  of  that  opinion  could  not  be  re¬ 
jected  with  95$  confidence. 

Corollary  Finding  9.  The  test  between  means  was 
again  performed  using  the  same  formulas,  steps,  alpha  value, 
and  hypotheses.  The  question  examined  was  whether  or  not 
proposal  leveling  is  the  most  effective  way  of  getting  the 
best  coverage  on  an  aircraft  warranty. 

The  results  included  a  t  of  4.545  which  is  greater 
than  the  t'  of  2.12  which  must  be  exceeded  to  reject  the 
null.  Therefore,  the  null  was  rejected  with  95$  confidence. 
This  means  the  Air  Force  experts  perceived  the  airline  ex¬ 
perts'  beliefs  to  be  different  from  what  they  actually  were. 
The  interval  for  this  difference  indicated  the  Air  Force  ex¬ 
perts  believed  the  airlines  would  view  proposal  leveling  to 
be  more  beneficial  than  the  airline  experts  actually  did 
from  between  1.9  to  5-2  on  the  Likert  scale. 

Summary  of  Corollary  Findings 

In  the  Corollary  Findings,  the  results  supported 
the  hypotheses  of  similarity  between  airline  and  ASD 
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experts'  opinions  concerning  the  cost  effectiveness  of  a 
warranty  and  whether  or  not  it  is  negotiable.  In  both  cases 
the  ASD  experts'  perceptions  of  the  airlines  coincided  with 
the  airline  experts'  responses.  No  evidence  was  found  to 
support  the  contention  that  larger  trunk  carriers  view  the 
warranty  to  be  more  negotiable  than  smaller  trunk  carriers 
do . 

It  was  also  found  that  the  use  of  proposal  leveling 
and  the  experts’  perceptions  of  the  effectiveness  of  it  were 
approximately  the  same  for  the  airline  experts  and  the  ASD 
experts.  However,  it  was  also  found  that  the  ASD  experts 
believed  the  airlines  used  proposal  leveling  and  falsely  be¬ 
lieved  that  the  airline  experts  would  consider  proposal 
leveling  to  be  more  effective  than  the  airline  experts  ac¬ 
tually  did. 

Finally,  insufficient  agreement  was  found  among  the 
ASD  experts'  perceptions  of  the  airi ines ’  ranking  of  the  cri¬ 
teria  to  formulate  a  consolidated  list  of  the  ASD  experts' 
perceptions  of  the  airlines. 
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Chapter  4 


CONCLUSIONS 


Overview 

This  chapter  contains  conclusions  derived  from  the 
findings  in  Chapter  3*  The  objective  of  this  research  pro¬ 
ject  was  to  determine  the  criteria  used  by  the  trunk  car¬ 
riers,  in  evaluating  an  aircraft  warranty  to  determine  if 
these  criteria  can  be  applied  to  Air  Force  aircraft  acqui¬ 
sitions  when  seeking  a  commercial  aircraft  warranty,  and  to 
determine  if  ASD  contracting  experts  place  a  similar  empha¬ 
sis  on  those  criteria  when  evaluating  an  aircraft  warranty. 

The  primary  findings  related  to  these  objectives  are 
presented  in  this  chapter  followed  by  corollary  conclusions 
which  were  derived  from  other  information  developed  through 
the  interviews  with  airline  experts  and  the  questionnaire . 

Research  Hypothesis  1 

The  airlines  use  a  homogeneous  set  of  criteria  to 
evaluate  warranties . 

Hypothesis  Sup-port.  Research  Hypothesis  1  was  sup¬ 
ported.  The  results  of  the  Kendall  W  test  shown  in  Chapter 
3  indicated  a  high  degree  of  correlation  between  the  rankings 
of  the  criteria  given  by  the  airline  contracting  experts. 

The  established  significance  of  the  correlation  of  95$  cer¬ 
tainty  was  exceeded. 
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General  Conclusions.  The  primary  conclusion  derived 
from  Research  Hypothesis  1  is  that  the  airlines  do  evaluate 
an  aircraft  warranty  in  much  the  same  way.  By  using  the  mean 
ranks  of  the  airline  experts  to  find  natural  Breaks  in  order 
to  group  the  criteria  By  importance  to  the  airline  experts 
the  list  shown  in  Figure  6  was  developed.  The  clearest 
Break  in  the  means  appeared  Between  the  top  8  and  Bottom  4 
criteria,  thus  the  least  important  criteria  could  Be  easily 
discerned . 

Research  Question  1 

Can  the  airline  criteria,  if  they  exist,  Be  legally 
applied  to  Air  Force  aircraft  acquisitions? 

General  Conclusions.  As  indicated  in  the  previous 
chapter,  interviews  with  three  government  lawyers  indicated 
no  legal  reasons  why  the  airline  criteria  could  not  Be  ap¬ 
plied  to  Air  Force  aircraft  procurements. 

Research  Hypothesis  2 

Contracting  experts  in  the  Air  Force  agree  with  the 
commercial  airline  contracting  personnel  in  the  order  of 
importance  of  the  criteria  used  in  evaluating  warranties . 

Hypothesis  Support .  This  hypothesis  was  not  sup¬ 
ported  in  our  research.  The  ASD  contracting  experts  were 
found  to  Be  a  homogeneous  group  in  terms  of  ranking  the 
criteria.  This  level  of  significance  for  this  part  of  the 
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Mean  Rank 


Criteria 


2.89 

The  warranty  guarantees  that  the  seller  will  re¬ 
design  and  replace  components  if  they  fail  with 
exceptional  frequency. 

4.67 

The  length  of  coverage  on  aircraft  components, 
measured  by  Mean  Time  Between  Failure  (MTBF) . 

4.67 

The  past  performance  of  the  seller  on  warranties. 

5.7  8 

The  scope  of  coverage  should  be  increased  to  in¬ 
clude  components  which  historically  have  problems. 

6.33 

The  warranty  permits  us  to  repair  parts  for  reim¬ 
bursement  . 

6.44 

The  coverage  on  particular  components  is  in  the 
most  appropriate  unit  of  measure,  that  is  in 
hours  or  months  or  cycles . 

7.00 

The  reliability  of  the  same  or  similar  components 
presently  in  service. 

7.22 

The  coverage  of  a  new  design  should  be  greater  due 
to  greater  risk. 

7.67 

The  past  performance  of  the  aircraft  series. 

7.89 

The  coverage  on  the  aircraft  offered  by  the  man¬ 
ufacturer  compared  to  that  offered  by  others. 

8.56 

The  warranty  is  cost  effective,  that  is,  the  cost 
of  the  warranty  is  less  than  the  savings  realized 
with  the  warranty. 

8.89 

The  right  to  make  or  buy  parts  from  others  for 
reimbursement  if  the  seller  cannot  supply  them. 

Figure  6.  Airline  Criteria  Ordered  "by  Mean  Rank. 
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test  was  greater  than  99-9%.  This  result  shows  that  the 
ASD  contracting  experts  rank  the  criteria  in  the  same  order. 

However,  the  comparison  of  the  rankings  obtained 
from  the  ASD  contracting  experts  with  the  rankings  obtained 
from  the  commercial  airline  contracting  personnel  did  not 
show  correlation.  A  visual  inspection  of  the  rankings  ob¬ 
tained  from  the  two  sources  revealed  three  criteria  with  a 
difference  in  ranking  of  greater  than  five  ranks.  These 


criteria 

are  listed  in 

Figure  7 • 

ASD 

Experts 

Rank 

Commercial 

Airline 

Contracting 

Personnel 

Rank 

Criteria 

8 

2 

The  past  performance  of  the  sellers 
of  warranties . 

11 

5 

The  warranty  permits  us  to  repair 
parts  for  reimbursement . 

1 

11 

The  warranty  is  cost  effective, 
that  is,  the  cost  of  the  warranty  is 
less  than  the  savings  realized  with 
the  warranty. 

Figure  7-  Criteria  Which  Differ  by  More  Than  Five  Ranks. 

An  attempt  was  made  to  find  correlation  between  the 
rankings  of  the  two  groups  by  individually  deleting  each  of 
the  three  criteria  identified  in  Figure  7  and  recomputing 
the  Spearman  rank  correlation  coefficient.  The  results  of 
this  test  are  shown  in  Appendix  P.  The  results  of  deleting 
the  cost  effectiveness  criteria  showed  that  with  95% 
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confidence  the  ASD  contracting  experts  agree  with  the  commer¬ 
cial  airline  contracting  personnel  in  ranking  the  remaining 
eleven  criteria  in  order  of  importance.  Individual  dele¬ 
tion  of  the  other  two  criteria  did  not  result  in  correla¬ 
tion  . 

General  Conclusions.  The  ASD  contracting  experts  do 
not  agree  with  the  rankings  obtained  from  the  commercial  air¬ 
line  contracting  personnel  in  order  of  importance  of  the 
twelve  criteria.  Correlation  was  found  to  exist  if  the  cri¬ 
teria  of  cost  effectiveness  is  not  included. 

It  was  stated  in  interviews  with  the  commercial  air¬ 
line  contracting  personnel  that  the  cost  of  the  warranty  is 
impossible  to  determine  because  the  warranty  is  not  an 
optional  item.  The  commercial  airline  contracting  personnel 
therefore  believe  that,  because  cost  effectiveness  of  a  war¬ 
ranty  is  impossible  to  calculate,  the  criteria  of  cost  ef¬ 
fectiveness  is  of  little  importance. 

The  ASD  experts  had  a  different  view  of  cost  ef¬ 
fectiveness  .  The  ASD  experts  stated  that  in  purchasing  a 
major  weapon  system,  such  as  a  new  aircraft,  it  is  extremely 
important  to  justify  every  element  of  cost.  Therefore,  even 
though  the  cost  of  the  warranty  and  the  resultant  savings 
are  extremely  difficult  to  measure,  the  contracting  officer 
must  be  able  to  show  a  cost  benefit  from  obtaining  a  war¬ 
ranty.  This  may  have  led  the  ASD  experts  to  rank  the  cost 
effectiveness  criteria  as  the  most  important  criteria  in 
evaluating  a  warranty. 
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Research  Question  2 


Can  a  list  of  criteria  be  developed  for  application 
of  commercial  aircraft  warranties  in  the  Department  of  De¬ 
fense? 

General  Conclusions.  A  list  of  criteria  derived 
from  the  airlines  applicable  to  DOD  aircraft  procurement 
was  presented  in  Figure  5,  page  46.  This  list  is  presented 
in  order  of  the  mean  of  the  ranks  of  the  criteria  provided 
by  the  airlines.  Criteria  were  deleted  from  this  list  in 
light  of  opinions  expressed  by  the  ASD  experts  interviewed. 
The  list  of  criteria  which  were  deleted  are  also  shown  in 
Figure  5* 

The  most  significant  difference  between  the  airline 
experts  and  ASD  experts  in  evaluating  a  warranty,  the  cost 
effectiveness  of  the  warranty,  was  included  in  the  list  of 
criteria  applicable  to  DOD  aircraft  procurements,  however, 
its  ranking  clearly  indicates  that  this  is  the  least  import¬ 
ant  of  the  criteria  listed.  If  the  government  is  to  follow 
commercial  practices  more  closely  in  evaluating  aircraft 
warranties  then  less  emphasis  on  this  criterion  by  acquisi¬ 
tion  personnel  would  be  appropriate.  Further,  more  emphasis 
should  be  placed  on  past  performance  of  the  seller  on  war¬ 
ranties  and  if  the  situation  permits,  gaining  provisions 
which  permit  the  government  to  repair  parts  for  reimburse¬ 
ment  . 
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Finally,  a  complete  list  of  criteria  for  evaluating 
an  aircraft  warranty  should  include,  according  to  ASD  expert 
Mr.  Robert  Kinderman,  an  evaluation  of  the  simplicity  of 
the  warranty  clauses.  This  additional  criteria  seems  appro¬ 
priate  in  order  to  avoid  costly  litigation  due  to  the  pos¬ 
sibility  of  ambiguities  arising  out  of  complex  clauses. 

Corollary  Conclusions 

This  portion  of  the  study  contains  the  conclusions 
for  the  nine  corollary  findings  described  in  the  previous 
chapter . 

The  first  corollary  finding  indicated  that  there  was 
no  significant  difference  between  the  larger  four  trunk  car¬ 
riers  experts,  and  the  smaller  five  trunk  carrier  experts 
on  the  question  of  whether  or  not  they  treat  the  aircraft 
warranty  as  a  negotiable  item,  in  fact,  all  of  the  airlines 
except  one  responded  with  a  1  for  strongly  agree  with  the 
statement.  Only  one  airline  expert,  a  smaller  trunk  expert, 
responded  differently  to  the  question.  This  one  expert  re¬ 
sponded  that  he  strongly  disagreed  with  the  statement. 
Clearly,  there  was  wide  agreement  among  the  airline  experts, 
both  large  and  small  airlines,  that  the  warranty  is  treated 
as  a  negotiable  item  by  their  airlines.  At  the  same  time,  it 
should  be  pointed  out  that  the  sample  of  large  and  small 
trunk  carriers  was  very  small  and  results  could  have  easily 
been  effected  by  only  one  respondent.  Therefore,  while 
there  appears  to  be  wide  agreement  on  this  question  between 
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the  large  and  small  trunk  carriers,  further  study  is  war¬ 
ranted  to  add  certainty  to  this  conclusion. 

In  the  second  through  fourth  corollary  findings  the 
hypothesis  could  not  he  rejected  that  there  was  agreement 
between  the  airline  experts'  views  and  the  ASD  experts' 
views,  on  the  three  questions  ranked  on  a  Likert  scale  from 
strongly  agree  to  strongly  disagree.  While  the  null  hypo¬ 
thesis  could  not  be  rejected  in  the  three  cases,  the  means 
of  two  of  the  three  revealed  possible  differences  had  the 
sample  sizes  been  larger.  The  average,  or  mean,  response  of 
the  airline  experts  on  the  first  statement,  that  the  aircraft 
warranty  is  treated  as  a  negotiable  item  by  their  airline, 
indicated  slightly  stronger  agreement  than  the  response  by 
the  ASD  experts.  On  the  second  statement,  that  the  price 
of  a  warranty  is  more  than  offset  by  the  benefits  of  the 
coverage,  the  reverse  was  true.  That  is,  the  mean  response 
by  the  ASD  experts  indicated  slightly  more  agreement  than 
the  responses  of  the  airline  experts.  Of  the  three  state¬ 
ments,  the  strongest  agreement  between  ASD  experts  and  air¬ 
line  experts  was  on  whether  or  not  proposal  leveling  is  the 
most  effective  way  of  getting  the  best  coverage  on  an  air¬ 
craft  warranty.  Both  groups  tended  to  strongly  disagree 
with  the  statement. 

The  fifth  corollary  finding  related  to  the  last 
question  on  the  questionnaire.  Respondents  were  asked  to 
answer  yes  or  no  to  the  statement  "we  use  the  proposal 
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leveling  technique  to  get  a  better  aircraft  warranty".  As 
pointed  out  in  the  findings,  all  primary  airline  respondents 
and  all  ASD  respondents  hut  one  responded  no.  The  remaining 
ASD  respondent  and  one  unsolicited  airline  contract  admin¬ 
istrator  responded  yes.  There  was  near  universal  agree¬ 
ment  among  the  respondents  that  they  do  not  use  the  tech¬ 
nique.  On  the  other  hand,  when  asked  their  perception  of 
the  airlines'  practices,  most  of  the  Air  Force  experts  ex¬ 
pressed  their  belief  that  the  airlines  do  use  the  technique. 
As  previously  mentioned,  not  only  is  technical  leveling 
against  defense  regulations,  but  it  is  also  against  corpor¬ 
ate  policy  among  the  airlines  according  to  the  airline  re¬ 
spondents.  Six  of  the  nine  ASD  experts  felt  the  airlines 
do  use  proposal  leveling.  Like  the  "grass  is  greener"  at¬ 
titude  that  seems  to  be  reflected  in  the  ASD  perceptions  of 
airline  practices  was  the  comment  by  one  airline  expert  ex¬ 
pressing  his  belief  that  Air  Force  contracting  officers  may 
use  the  technique  but  that  his  airline  does  not.  No  evi¬ 
dence  was  uncovered  to  indicate  that  either  the  airline  con¬ 
tracting  executives  or . the  Air  Force  contracting  officers 
violate  their  respective  "company  policy"  more  frequently. 

The  sixth  corollary  finding  showed  that  the  ASD 
contracting  personnel,  have  an  incorrect  perception  of  the 
commercial  airline  procedures  in  evaluating  warranties. 

The  results  of  the  Kendall  W  test  presented  in  Chapter  3 
showed  the  ASD  contracting  experts  do  not  have  a  consistent 
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view  of  the  commercial  airline  practices.  Without  a  con¬ 
sistent  view,  a  comparison  of  ASD  experts  perceptions  of  the 
order  of  importance  and  the  airlines  actual  rankings  would 
he  inappropriate. 

The  conclusion  drawn  from  this  finding  is  the  ASD 
contracting  experts  need  better  information  on  the  commer¬ 
cial  airline  procedures  used  in  evaluating  warranties.  If 
the  ASD  contracting  community  is  to  effectively  use  commer¬ 
cial  practices  in  evaluating  warranties,  it  is  imperative 
that  the  ASD  contracting  community  understand  the  commercial 
practices . 

The  results  of  the  seventh  and  eighth  corollary 
findings  show  that  the  ASD  experts'  perceptions  of  the  com¬ 
mercial  airline  practices  do  not  significantly  differ  from 
the  actual  commercial  airline  practices.  The  ASD  experts' 
perception  that  the  commercial,  airlines  treat  the  warranty  as 
negotiable  is  an  accurate  perception.  With  the  exception  of 
one  commercial  airline,  all  respondents  felt  very  strongly 
that  the  warranty  is  a  negotiable  item.  The  results  of  the 
eighth  corollary  finding  showed  no  significant  difference 
between  the  commercial  airline  contracting  personnel  and  the 
ASD  experts  perceptions  of  the  airlines  in  the  area  of  cost 
effectiveness.  The  response  to  this  question  reflects  the 
difficulty  in  measuring  the  cost  effectiveness  of  the  war¬ 
ranty.  Both  the  commercial  airline  contracting  personnel 
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and  the  ASD  perception  fall  around  the  middle  of  the  scale. 
The  respondents  did  not  agree  or  disagree  with  the  state¬ 
ment  that  the  warranty  is  cost  effective. 

The  ninth  corollary  finding  showed  that  there  is  a 
misconception  with  the  ASD  contracting  community  that  the 
commercial  airlines  use  proposal  leveling.  The  results  of 
the  statistical  test  presented  in  Chapter  3  showed  that 
there  is  a  significant  difference  "between  the  ASD  experts' 
perceptions  and  the  actual,  commercial,  airline  contracting 
personnel's  response  to  the  question  on  the  effectiveness 
of  proposal  leveling.  The  commercial  airline  contracting 
personnel  strongly  disagreed  with  the  statement  and  the  ASD 
experts'  perception  was  that  the  commercial  airlines  would 
agree  with  the  statement.  This  response  was  supported  "by 
the  response  to  the  question  of  whether  the  airlines  use 
proposal  leveling.  An.  nine  airline  contracting  personnel, 
answered  this  question  no  and  most  airlines  commented  that 
this  procedure  is  unethical.  The  ASD  experts'  perceptions, 
"by  contrast,  were  that  proposal  1  eveling  is  used  "by  the  air- 
1  ines  (six  of  the  nine  respondents  answered  yes). 
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Chapter  5 


RECOMMENDATIONS 

This  chapter  contains  recommendations  of  a  general 
nature  concerning  how  commercial  practices  studied  herein 
can  he  implemented  in  Air  Force  aircraft  acquisitions  and 
recommendations  for  further  research. 

General  Recommendations 

The  following  recommendations  are  offered: 

1 .  In  order  for  DOD  to  evaluate  aircraft  warranties 
in  a  manner  similar  to  that  of  the  airlines,  the  following 
criteria  should  he  used  with  the  first  criterion  considered 
the  most  important  and  the  last  criterion  the  least  impor¬ 
tant. 

A.  The  warranty  guarantees  that  the  seller  will  re¬ 
design  and  replace  components  if  they  fail  with  exceptional 
frequency . 

B.  The  length  of  coverage  on  aircraft  components, 
measured  hy  Mean  Times  Between  Failure  (MTBF) . 

C.  The  past  performance  of  the  seller  on  warranties. 

D.  The  scope  of  coverage  should  he  increased  to  in¬ 
clude  components  which  historically  have  problems. 
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E.  The  coverage  on  particular  components  is  in  the 
most  appropriate  unit  of  measure,  that  is  in  hours  or  months 
or  cycles. 

F.  The  reliability  of  the  same  or  similar  components 
presently  in  service. 

G.  The  past  performance  of  the  aircraft  series. 

H.  The  coverage  on  the  aircraft  offered  by  the  man¬ 
ufacturer  compared  to  that  offered  by  others. 

I.  The  warranty  is  cost  effective,  that  is,  the 
cost  of  the  warranty  is  less  than  the  savings  realized  with 
the  warranty. 

This  ranking  differs  from  that  given  by  ASD  ex¬ 
perts  when  they  were  asked  to  rank  these  criteria.  This 
difference  was  most  pronounced  in  their  ranking  of  three  cri¬ 
teria,  indicating  a  particular  need  for  a  change  in  emphasis 
in  these  areas  when  evaluating  a  warranty.  Two  of  these 
areas  are  found  in  General  Recommendations  2  and  3.  The 
other  criterion  was  not  considered  applicable  to  government 
acquisitions  for  the  reasons  explained  in  Chapter  3,  Re¬ 
search  Question  2. 

2.  Less  emphasis  on  cost  effectiveness  of  a  war¬ 
ranty  is  needed.  The  airline  experts  ranked  this  criterion 
11th  out  of  12,  while  the  ASD  experts  ranked  this  first. 

As  several  experts,  in  both  airlines  and  ASD,  pointed  out 
the  cost  effectiveness  of  a  warranty  cannot,  at  present,  be 
determined.  The  airlines’  solution  to  this  problem  seems 
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to  "be  to  decrease  the  emphasis  on  the  cost  of  the  warranty 
and  to  emphasize  criteria  which  are  related  to  the  potential 
benefits  of  the  warranty.  In  order  to  follow  airline  prac¬ 
tices  in  this  area,  the  Department  of  Defense  should  do  the 
same . 

3*  Greater  emphasis  should  he  placed  on  the  past 
performance  of  the  seller  on  warranties.  The  airline  ex¬ 
perts  ranked  this  criterion  2nd  while  the  ASD  experts  ranked 
it  8th. 

4.  A  booklet  explaining  commercial  aircraft  war¬ 
ranty  procedures  should  be  published  to  assist  the  contract¬ 
ing  officer  in  following  the  commercial  practices  he  is  ex¬ 
pected  to  follow.  This  need  is  indicated  by  the  fact  that 
there  is  such  a  wide  range  of  opinion  regarding  airline 
practices,  that  insufficient  agreement  existed  among  the 
Air  Force  experts  questioned  for  the  researchers  to  ascer¬ 
tain  a  general  perception  of  the  Air  Force  experts  as  to 
what  the  airline  practices  are. 

5-  This  study  revealed  no  disadvantage  to  the  gov¬ 
ernment  in  negotiating  an  aircraft  warranty,  than  the  air¬ 
lines  face  in  their  negotiations ,  due  to  the  DAR's  prohibi¬ 
tion  on  proposal  leveling.  The  airlines,  like  the  government, 
consider  the  practice  unethical.  Therefore  no  evidence  was 
found  to  show  that  this  prohibition  should  be  stopped  in 
order  to  bring  the  government  practices  in  line  with  airline 
practices . 
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Recommendations  for  Further 

Study  ~  * 


The  following  are  offered  as  areas  of  further  study: 

1.  This  study  showed  disagreement  among  Air  Force 
contracting  experts  as  to  commercial  practices  in  this  field. 
Further  study  in  commercial  practices  in  warranties  and 
other  fields  would  give  acquisition  experts  a  "better  under¬ 
standing  of  commercial  practices  and  how  to  implement  those 
practices  when  appropriate. 

2.  Further  study,  utilizing  larger  samples,  is 
needed  to  confirm  initial  findings  in  this  study  concerning 
the  criteria  and  methods  used  "by  airlines  in  evaluating  and 
negotiating  warranties.  Such  a  study  might  examine  dif¬ 
ferences  in  criteria  and  procedures  used  by  various  sizes 

of  airlines  including  regional  airlines.  By  studying  smaller 
airlines,  researchers  might  "be  able  to  investigate  if  cri¬ 
teria  used  in  evaluating  warranties  on  small  aircraft  are 
different  than  those  on  larger  aircraft. 

3-  A  study  to  determine  criteria  to  evaluate  the 
"benefits  of  a  warranty  already  in  existence  to  include  the 
operational  and  cost  "benefits. 

4.  A  study  to  evaluate  the  "benefits  of  commercial 
aircraft  warranties  that  have  "been  "bought  in  such  programs 
as  the  KC-10,  to  identify  differences  "between  those  war¬ 
ranties  and  airline  warranties  and  to  offer  lessons  learned. 

5*  At  present,  no  known  algorithm  exists  which 
permits  the  evaluation  of  the  cost  and  savings  from  an 
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aircraft  warranty  either  proposed  or  in  use.  Such  an  algo¬ 


rithm  would 
warranty  or 


be  of  great  benefit  in  justifying  a  proposed 
in  learning  from  past  warranties. 
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APPENDIX  A 

INTERVIEW  GUIDE  NO.  1 
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1 . 


Date 


2.  Individual  Interviewed 


3-  Airline/Office 


4.  What  criteria  do  you  use  in  evaluating  an  aircraft  war¬ 
ranty? 


5-  Do  you  know  of  any  other  criteria  used  by  other  acqui¬ 
sition/contracting  officers  in  evaluating  an  aircraft 
warranty? 
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APPENDIX  B 

LIST  OF  UNITED  STATES  TRUNK  CARRIERS 
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AIRLINE 


TOTAL  NUMBER  OF  AIRCRAFT  1978 


American 

250 

Braniff 

100 

Continental 

60 

Delta 

200 

Eastern 

236 

Northwest  Orient 

106 

Pan  Am 

94 

TWA 

208 

United 

3^1 

Western 

79 

Note:  The  numbers  of  aircraft  are  provided  to  indicate  the 

size  of  the  trunk  carriers .  The  aircraft  included  in 
the  list  are  Boeing  B-707.  B-720,  B-727,  B-737,  B-7^7; 
McDonnell  Douglas  DC-8,  DC-9,  DC-10,  DC-9-50;  and 
Lockheed  L-1011,  L-188.  All  other  airlines,  clas¬ 
sified  as  local  service  carriers,  have  considerably 
fewer  of  these  types  of  aircraft  with  the  exception 
U.  S.  Air  (Allegheny)  which  possesses  53  of  them. 
However,  Allegheny,  due  to  other  factors  is  not  con¬ 
sidered  a  trunk  carrier. 
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APPENDIX  C 

COVER  LETTER  FOR  QUESTIONNAIRE 
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REPLY  TO 

ATTN  OF:  RTAO:  Captain  Tom  Sutliff  and  Captain  Jack  Grubb, 

afit/ls 

SUBJECT:  Questionnaire  on  Warranty  Criteria 


TO: 


Dear  Mr. 

The  attached  questionnaire  concerns  warranty  pro¬ 
cedures  and  criteria.  As  we  mentioned  in  our 
telephone  conversation  a  couple  of  weeks  ago,  we're 
pursuing  a  degree  in  Contracting  and  Acquisition 
Management  and  our  Master's  thesis  is  concerned 
with  whether  or  not  procedures  and  criteria  used 
by  the  airlines  in  evaluating  warranties,  on  new 
aircraft  purchases  can  be  used  by  the  U.S.  Air  Force. 

We're  asking  that  you  rank  the  criteria  listed  on 
the  next  page  in  order  of  importance  from  1  through 
12  that  your  airline  considers  when  receiving  and/or 
negotiating. a  warranty  on  a  new  aircraft  purchase. 
(Please  assign  each  ranking  to  only  one  criterion 
with  1  being  the  most  important  and  12  the  least  im¬ 
portant).  We  also  ask  that  you  answer  the  questions 
on  your  warranty  procedures  and  finally  add  any  com¬ 
ments  that  you  have  on  warranty  criteria  and  pro¬ 
cedures  on  the  back  of  the  questionnaire. 

We  realize  that  you  may  be  concerned  with  the  con¬ 
fidentiality  of  your  responses  therefore,  no  men¬ 
tion  of  any  particular  airline  will  be  given  in  any 
written  or  oral  reports  in  association  with  any 
replies  on  this  questionnaire. 

One  last  request,  we'd  appreciate  it  if  you'd  mail 
our  questionnaire  in  the  enclosed  envelope  as  soon 
as  possible  to  help  us  meet  our  thesis  deadline. 

If  you  have  any  questions,  please  call  us  at  513- 
879-3111  or  513-252-9025  collect.  Thank  you  for 
your  assistance  with  both  telephone  interviews  and 
this  questionnaire. 

Yours  truly, 


2  Atch:  Questionnaire  Tom  Sutliff  &  Jack  Grubb 

Envelope 
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APPENDIX  D 
QUESTIONNAIRE 
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Warranty  Criteria  Please  rank  according  to  importance  from 

1  to  12 

_ The  length  of  coverage  on  aircraft  components,  measured 

"by  Mean  Time  Between  Failure  (MTBF) 

_ The  past  performance  of  the  seller  on  warranties . 

_ The  coverage  on  particular  components  is  in  the  most  ap¬ 
propriate  unit  of  measure,  that  is  in  hours  or  months 
or  cycles. 

_ The  reliability  of  the  same  or  similar  components  pre¬ 
sently  in  service. 

_ The  warranty  permits  us  to  repair  parts  for  reimbursement . 

_ The  warranty  guarantees  that  the  seller  will  redesign 

and  replace  components  if  they  fail  with  exceptional 
frequency . 

_ The  coverage  of  a  new  design  should  be  greater  due  to 

greater  risk. 

_ The  scope  of  coverage  should  be  increased  to  include  com¬ 
ponents  which  historically  have  problems. 

_ The  past  performance  of  the  aircraft  series. 

_ The  right  to  make  or  buy  parts  from  others  for  reimburse¬ 
ment  if  the  seller  cannot  supply  them. 

_ The  warranty  is  cost  effective,  that  is,  the  cost  of  the 

warranty  is  less  than  the  savings  realized  with  the 
warranty . 

_ The  coverage  on  the  aircraft  offered  by  the  manufacturer 

compared  to  that  offered  by  others. 

Please  circle  the  most  appropriate  answer  on  the  scale  pro¬ 
vided  from  1  for  strongly  agree  to  7  for  strongly  disagree . 

123^567  The  aircraft  warranty  is  treated  as  a  negotiable 
item  by  your  airline. 

1  2  3  ^  5  6  7  The  price  of  a  warranty  on  an  aircraft  is  more 
than  offset  by  the  benefits  of  the  coverage. 

123^567  Proposal  leveling*  is  the  most  effective  way  of 

getting  the  best  coverage  on  an  aircraft  warranty. 

Yes  No 

1  2  We  use  the  Proposal  leveling*  technique  to  get  a  better 

aircraft  warranty. 

*  Proposal  leveling:  the  act  of  providing  a  competing  contractor 
with  information  on  the  proposal  of  another  competing  con¬ 
tractor  for  the  purpose  of  eliciting  a  better  offer  from  the 
first  contractor-~sometimes  called  Chinese  Auctioning. 
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APPENDIX  E 

KENDALL  COEFFICIENT  OF  CONCORDANCE 
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The  following  procedure  was  used  to  calculate  the 
Kendall  coefficient  of  concordance  W  (16:237) • 

1.  Sum  the  rank  for  each  criteria  (R.). 

0 

2.  Divide  the  sum  (R.)  by  the  number  of  criteria 

J 

ranked  (N) . 

3-  Calculate  the  deviation  of  each  R.  from  the  mean 

J 

R.,  square  the  value  and  sum. 

J 

4.  Calculate  the  Kendall  W  by  taking  the  value 
obtained  in  3  and  dividing  by  the  maximum  squared  deviations. 


W  = 


1§K  (N  -N) 


where 


S  = 


Ro  ' 

N  = 
K  = 


SR.  2 

z  lRrV-> 


•th 


rank  of  the  j  criteria 

number  of  criteria  ranked 

number  of  respondents  who  ranked  criteria 
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APPENDIX  F 


SPEARMAN  RANK  CORRELATION  COEFFICIENT 
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The  following  procedure  was  used  to  calculate  the 
Spearman  rank  correlation  coefficient  rg  (16:212-213). 

1.  List  the  rank  for  each  criteria  received  from 
the  commercial  airline  contracting  personnel  heside  the  rank 
for  the  same  criteria  received  from  the  USAF  contracting 
officers . 

2.  Calculate  the  difference  (di)  between  the  rank 
given  by  the  commercial  contracting  personnel  and  the  rank 
given  by  the  USAF  contracting  officers  for  each  rank. 

Square  each  difference  and  sum  the  squares  for  each  criteria 
(Edi2). 

3*  Calculate  r  using  the  following  formula: 
s 


rs  =  1  - 


6zdi2 

N3-N 


where: 

di  =  the  difference  between  ranking  for  each  in¬ 
dividual  criteria 

N  =  the  number  of  criteria  ranked 


4 
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APPENDIX  G 

RESPONSES  OF  THE  AIRLINE  EXPERTS 
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R 

ANKS 

OF  1 

’HE  C 

RITERIA  BY  AIRLINE  EXPERTS 

QUESTIONS 

A 

B 

C 

D 

E 

F 

G 

H 

I 

J 

K 

L 

/ 

* 

B 

C 

D 

Expert 

1 

6 

5 

8 

10 

4 

1 

3 

9 

11 

7 

12 

2 

/ 

4 

7 

2 

Expert 

1 

2 

1 

6 

9 

7 

8 

2 

4 

5 

10 

11 

12 

3 

/ 

1 

4 

3 

1 

2 

-  3 

1 

4 

8 

3 

7 

12 

9 

10 

6 

2 

11 

/ 

7 

7 

7 

2 

3 

4 

4 

5 

2 

6 

3 

1 

7 

8 

9 

12 

11 

10 

/ 

5 

7 

2 

4 

5 

1 

6 

8 

9 

5 

2 

7 

4 

10 

3 

11 

12 

/ 

2 

7 

2 

5 

6 

3 

9 

10 

7 

6 

1 

2 

5 

4 

12 

8 

11 

/ 

7 

5 

6 

2 

6 

7 

9 

1 

6 

7 

LO 

5 

12 

8 

2 

11 

4 

3 

/ 

i 

1 

7 

2 

7 

8 

5 

3 

7 

4 

12 

6 

11 

1 

2 

8 

9 

10 

/ 

l 

5 

7 

2 

8 

9 

12 

2 

4 

5 

6 

1 

7 

3 

11 

10 

8  . 

9 

/ 

l 

1 

7 

2 

9 

Total  1 

42  - 

1-2 

58 

63 

57 

26 

65 

52 

69 

80  ‘ 

77 

ST 

/ 

77 

34 

58 

18 

Total 
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RESPONSES  OF  ASD  EXPERTS 
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RANI 

KS  01 

THE 

CRITERIA  BY 

ASD  EXPERTS 

j  QUESTIONS 

A 

B 

C 

D 

E 

F 

G 

H 

I 

J 

K 

L 

/ 

A 

B 

C 

D 

Expert 

1 

3 

2 

11 

6 

7 

10 

4 

5 

9 

12 

1 

8 

/ 

3 

1 

7 

2 

Expert 

1 

2—.,, 

-in. 

2 

8 

Jt 

-11 . 

7 

3 

5 

12 

6 

9 

/ 

2 

4 

6 

2 

2 

3 

3 

10 

4 

5 

11 

8 

9 

6 

7 

12 

2 

1 

/ 

2 

2 

4 

2 

3 

4 

4 

9 

3 

8 

10 

2 

5 

7 

11 

6 

1 

12 

/ 

3 

4 

7 

2 

4 

5 

3 

10 

2 

7 

5 

4 

9 

8 

6 

12 

1 

11 

7 

2 

2 

5 

1 

5 

6 

2 

8 

1 

3 

10 

5 

4 

6 

7 

9 

11 

12 

l 

4 

2 

6 

2 

6 

7 

4 

11 

5 

10 

12 

1 

6 

2 

9 

8 

3 

7 

/ 

3 

1 

7 

2 

7 

8 

5 

12 

6 

2 

8 

3 

9 

10 

7 

4 

1 

11 

/ 

2 

5 

3 

2 

8 

9 

6 

7 

4 

3 

9 

2 

8 

5 

11 

12 

1 

10 

/ 

2 

4 

5 

2 

9 

Total 

4o 

71 

44 

48 

83 

36 

6l 

52 

72 

87 

27 

81 

L 

23 

25 

52 

17 

Total 
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AIR  FORCE  EXPERTS'  PERCEPTIONS  OF  AIRLINE  EXPERTS'  RESPONSES 
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1 

HR  F 

ORCE 

E 

EX  PI 

XPERP 

SRTS' 

PS  WO 

PER 

ULD 

CEPTION  OF  HOW  THE  AIRLINE 

RANK  THE  CRITERIA 

QUESTIONS 

A 

B 

C 

D 

E 

F 

G 

H 

I 

J 

K 

L 

/ 

A 

B 

C 

D 

Experl 

1 

4 

JL 

Z 

8 

11 

1 

6 

10 

3 

12 

9 

2 

7 

1 

2 

1 

Expert 

1 

2 

5 

3 

4 

6 

9 

8 

7 

11 

12 

10 

1 

2 

7 

1 

1 

3 

1 

2 

3 

2 

6 

10 

9 

5 

4 

3 

8 

7 

11 

12 

7 

4 

1 

1 

3 

4 

1 

10 

8 

9 

7 

5 

4 

3 

11 

6 

2, 

12 

7 

3 

3 

6 

2 

4 

5 

10 

6 

8 

7 

5 

2 

12 

11 

4 

9 

1 

3 

7 

6 

2 

2 

1 

5 

6 

10 

5 

9 

2 

6 

11 

7 

4 

1 

12 

8 

3 

7 

1 

3 

6 

2 

6 

7 

11 

5 

12 

6 

10 

4 

3 

7 

2 

8 

1 

9 

6 

4 

1 

2 

7 

8 

12 

3 

2 

7 

8 

9 

11 

6 

5 

10 

1 

4 

/ 

4 

3 

1 

8 

9 

5 

2 

6 

8 

10 

3 

11 

4 

12 

7 

1 

9 

/ 

2 

4 

2 

1 

9 

Total 

6o 

45 

66 

62 

71 

47 

64 

64 

57 

85 

36 

45 

/ 

26 

26 

26 

12 

Total 
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MEAN  RANKS  OF  CRITERIA  FROM  AIRLINES 
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Criteria 

Mean 

Rankii 

A 

4.67 

2 

B 

4.67 

2 

C 

6.44 

6 

D 

7.00 

7 

E 

6.33 

5 

F 

2.89 

1 

G 

7.22 

8 

H 

5.78 

4 

I 

7.67 

9 

J 

8.89 

12 

K 

8.56 

11 

L 

7.89 

10 
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APPENDIX  K 

MEAN  RANKS  OF  CRITERIA  FROM  ASD  EXPERTS 
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Criteria 

A 

B 

C 

D 

E 

F 

G 

H 

I 

J 

K 

L 


Mean 

4.44 

7.89 

4.89 
5.33 
9.22 
4.00 

6.78 

5.78 
8.00 
9.67 
3-00 
9  .00 


Ranking 

3 
8 

4 

5 
11 
2 

7 

6 

9 

12 

1 

10 
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SPSS  PROGRAM  TO  CALCULATE  FRIEDMAN  TWO-WAY  ANOVA 
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RUN  NAME 

FRIEDMAN  TEST  FOR  THESIS 

VARIABLE  LIST 

ABCDEFGHI  JKL 

N  OF  CASES 

9 

INPUT  FORMAT 

FREEFIELD 

INPUT  MEDIUM 

CARD 

NPAR  TESTS 

FRIEDMAN  =  ABCDEFGHI  JKL/ 

READ  INPUT  DATA 
$  SELECT  AIRLINES 

FINISH 
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APPENDIX  M 


SPSS  PROGRAM  FOR  CALCULATING  SPEARMAN 
RANK  CORRELATION  COEFFICIENT  AND  KENDALL  TAU 


100 


RUN  NAME 

SPEARMAN  TEST  FOR  THESIS 

VARIABLE  LIST 

A,  B 

INPUT  MEDIUM 

CARD 

N  OF  CASES 

12 

INPUT  FORMAT 

FREEFIELD 

NONPAR  CORR 

A  WITH  B 

OPTION 

6 

READ  INPUT  DATA 
$  SELECT  FILENAME 

FINISH 
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APPENDIX  N 


FORTRAN  PROGRAM  FOR  CALCULATING  KENDALL  W 
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10  DIMENSION  IRANK(15.12) 

20  PRINT  ,  "ENTER  NUMBER  OF  JUDGES  AND  NUMBER  OF  CRITERIA" 

30  READ  ,  K.N 

40  DO  100  J  =  1,K 

50  PRINT  ,  "  " 

60  PRINT  900, J 

70  READ  ,  (IRANK(I,J) ,1-1, N) 

80  100  CONTINUE 
90  GRAND  =  0. 

100  DO  110  I  =  1 ,N 

110  T0TAL1  =  0. 

120  DO  105  J  =  1,K 

130  T0TAL1  =  T0TAL1  +  IRANK(I.J) 

140  105  CONTINUE 

150  RJ(I)  =  T0TAL1 

160  GRAND  =  GRAND  +  TOTALl 

170  110  CONTINUE 

180  XMEAN  =  GRAND  /  N 

190  S  =  0. 

200  DO  120  I  =  1 ,N 

210  S  =  S  +  (RJ(I)-XMEAN)**2 

220  120  CONTINUE 

230  W  =  (12*S)/(K**2*(N**3-N) 

24 0  CHI  =  K*(N-l)*W 

250  PRINT  ,  "  " 

260  PRINT  ,  "  " 

270  PRINT  901, W, CHI 

280  STOP 

290  900  FORMAT( IX, "ENTER  RANKS  FOR  JUDGE", 13) 

300  901  FORMAT( IX, "KENDALL  W  VALUE  IS",F8.5, 

310&  CHI-SQUARED  IS",F9.5) 

320  END 
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APPENDIX  0 


T-TEST  USED  ON  COROLLARY  FINDINGS  1-4,  7-9 
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The  test  used  was  simply  to  determine  if  the  dif¬ 
ference  between  the  means  was  greater  than  0.  Two  methods 
were  used  in  each  case  to  test  this  and  are  shown  below  to 
assist  the  reader  in  understanding  the  procedure.  The  cal¬ 
culations  for  corollary  finding  No.  1  are  shown.  The  data 
resulting  from  the  calculation  for  corollary  findings  1,  3 
and  4  are  also  shown. 

Hq:  -  p2  =  0  if  t<t  accept,  if  t>t  reject 

Hl:  4 1  "  ^2  ^  0 
a  =  .05 


To  find  t^  the  following  formuT  as  were  used: 

si/2 =  where  xi/2  = 

Airlines  ASD 


X1  =  =  1.6?; 


x2  -  — 3-  =  2.556 


D 


=  x2  -  =  .889 


s2  .  .  4-0  s2  .  E(.x72.?;6)2  . 

s2  =  iililfl  *  (W2~1)S2  _  (8)(4)  +  (8H  .  q28 1 
+N2-2  9  +  9  -  2 


.5278 

2.2639 


105 


s- 


S(D)  =  V  S2  S2  or  S  7  1 
N1  +  N2  N 


1  +  L 

N  N2 


S(D)  =  V  --|639  +  ---|639  =  .7093 


t  = 


(x2-x1)-0 


_  2.556-1.67-0 
.5299 


=  1.2525 


1 

1.254  or  t  <  2.12  t1  .*.  cannot  reject 


Using  the  information  already  calculated  a  95 %  con¬ 
fidence  interval  for  the  difference  can  "be  shown.  For  the 
95$  interval,  t(l-a/2;  n1+n£-2)  =  t ( . 975 ; 16 )  =  2.120  is 
used.  The  confidence  interval  is  5  +  t ( . 975 ; 16 ) [S( D) ]  or 
.889  +  2.120( .7093) •  Therefore,  the  confidence  interval  is: 


-.6147  <  | i2-\x1  <  2.393 


Therefore,  with  95 %  confidence,  it  can  he  stated 


that  the  mean  difference  between  the  ASD  and  airline  re¬ 
sponses  is  between  -.615  and  2.393.  Clearly,  the  null 
hypothesis  that  they  are  the  same  could  not  be  rejected.  Re¬ 
sults  from  the  corollaries  1-4,  7  and  8,  all  indicated  the 
null  could  not  be  rejected.  The  following  figures  were  ob¬ 
tained  for  Corollary  Findings  1,  3,  4,  7,  8,  and  9  using 
the  same  formulas  used  in  Corollary  Finding  2. 
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Corollary  Finding  1 
Big  Airlines 


N1  =  4 


4/2  =  3-29 

Sx1 -x2 , S(  D) 

t  =  .986 


-1.533  < 


Small  airlines 
x2  =  2.2 
S2  =  2.4 

n2  =  5 


=  1.217 

t1  =  2.365 

M-2~ 4^  3.953 


Corollary  Finding  3 
Airlines 
x1  =  3.777 
=  2.078 
N1  =  9 


Sl/2  3.324 


ASD 

x2  =  2.777 

s2  =  1.527 

N2  =  9 


^-X^SCD)  =  .912 

t  =  1.097  t1  =  2.12 

-•933  <  u1-n2  <  2.933 


Corollary  Finding  4 
Airlines 
x  =  6.444 


ASD 

x2  =  5.778 
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1-377 


S2  =  1.356 


Sl/2  =  1<86° 

Sx1-x2,S(D)  =  ,682 
t  =  .978 


"•78  <  n1-n2 

Corollary  Finding  7 
ASD 


x^  =  2.89 
=  2.2 
N1  =  9 

-2  =  3.431 


V2 


S-  -  S(D)  =  .873 
X1  x2 ' 


t  =  1.397 

-.631  <  ji.-jig  <  3 


Corollary  Finding  8 
Airlines 
xx  =  3-77 
s1  =  2.078 
N1  =  9 

4/2  - 


N2  =  9 


t1  =  2.12 
<  2.112 

Airlines 

x2  =  I.67 
S2  =  1.414 

N2  =  ^ 


t1  =  2.12 


ASD 

x2  =  2.88 

s2  =  1.269 
N2  =  9 
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S(D)  =  .61 


X1 _x2 ’ 
t  =  1.46 


-.4032  <  {L±-[i2  <  2.1832 


Corollary  Finding  9 

Airlines 

x  =  6. 444 
1 

=  1.377 

N1  =  9 

sl/z  -  2 -75“ 

S-  -  S(D)  =  .7822 
xl_x2 ’ 

t  =  4.545 


ASD 

x2  =  2.889 

s2  =  1.9 

N2  =  9 


t1  =  2.12 


1.897  <  JX1-|X2  <  5.213 
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APPENDIX  P 


SPEARMAN  RANK  CORRELATION  COEFFICIENT 
WITH  CRITERION  X  DELETED 
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Criteria  K  (The  Warranty  is  cost  effective,  that  is, 
the  cost  of  the  warranty  is  less  than  the  savings  realized 
with  the  warranty)  was  rejected  and  the  remaining  eleven 
criteria  were  ranked  from  one  to  eleven  using  the  mean  ranks. 
The  resultant  rankings  are  shown  "below. 


Criteria 

A 

B 

C 

D 

E 

F 

G 

H 

I 

J 

L 


ASD  Rank 


Airlines  Rank 


2 


2 


7 

3 

4 

10 

1 

6 

5 

8 

11 


2 

6 

7 
5 
1 

8 
4 
9 

11 


9 


10 


The  rankings  were  input  into  the  SPSS  program  listed 
in  Appendix  M.  The  output  showed  a  Spearman  rank  correla¬ 
tion  coefficient  of  0.6788  and  an  associated  significance 
level  of  0.011.  The  results  show  that,  with  "better  than 
95/6  confidence,  the  ranks  from  ASD  contracting  experts  agree 
with  the  ranks  from  the  commercial  airline  contracting  per¬ 


sonnel  when  criterion  K  is  deleted. 
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APPENDIX  Q 

SOURCES  OF  EXPERT  OPINION  FROM  THE  AIRLINES 
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Nine  airline  experts  were  surveyed  by  telephone  and 
with  the  questionnaire  relative  to  the  criteria  their  air¬ 
lines  use  to  evaluate  an  aircraft  warranty.  The  airlines 
were  picked  by  a  random  number  generator  on  the  Create  com¬ 
puter.  The  individuals  were  found  using  names  provided  by 
Air  Force  experts  and  the  1978  World  Aviation  Almanac.  These 
individuals  were  querried  to  ascertain  if  they  were  respon¬ 
sible  for  evaluating  aircraft  warranties.  When  appropriate, 
the  researchers  were  then  referred  to  other  personnel  in 
their  airlines  and  so  on  until  the  proper  individuals  were 
found. 


The  following  are  the  airline  experts  are  listed 

below  in  alphabetical  order  of  their  airlines: 

American  Airlines,  Inc. 

Attn:  Mr.  Van  Keaney 
3800  N.  Mingo  Rd. 

Tulsa,  OK. 

Braniff  Airline,  Inc. 

World  Headquarters 
Attn:  Mr.  Horace  Bolding 
Post  Office  Box  6174? 

Dallas -Fort  Worth  TX  75261 
Dallas,  Texas  75261 

Delta  Airline,  Inc. 

Attn:  Mr.  Roy  Rucker 
Atlanta  International  Airport 
Atlanta,  Georgia  30320 

Eastern  Airlines 
Attn:  Mr.  P.  G.  Mercer 
Miami  Int'l  Airport 
Miami,  Fla.  33148 
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North  West  Airlines  Inc. 

Attn:  Mr.  T.  E.  McGinnity 
Minneapolis -St .  Paul  Airport 
St.  Paul,  Minn.  55111 

Pan-American  World  Airways 
Attn:  Mr.  Ditchey 
P.  0.  Box  592055 
Airport  Mail  Drop 
Miami,  Florida  33159 

TWA,  Inc . 

Mr.  Wally  Callan 

Kansas  City  International  Airport 
Post  Office  Box  20367 
Kansas  City,  Mo.  64195 

United  Airline,  Inc. 

Attn:  Mr.  Jerry  Pollock  EXOPP 
P.  0.  Box  66100 
Chicago,  Ill.  60666 

Western  Airline ,  Inc . 

Attn:  Mr.  Bozarth 
6060  Avion  Dr. 

Los  Angeles,  CA.  90009 
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SOURCES  OF  EXPERT  OPINION  FROM  THE  AIR  FORCE 
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Nine  ASD  experts  were  given  the  questionnaire  to 

answer  in  accordance  with  the  design  for  Research  Hypothesis 

2.  These  experts  were  chosen  using  a  random  selection 

from  a  list  of  experts  supplied  hy  ASD/PM.  The  following 

minimum  qualifications  were  required  (1)  at  least  five  years 

experience  in  major  systems  procurement  at  ASD  (2)  experience 

in  working  on  an  aircraft  acquisition.  In  order  to  test 

Research  Question  1,  three  Air  Force  attorneys  experienced 

in  the  contracting  field  were  selected  according  to  their 

availability.  In  the  design  to  test  Corollary  Findings  6-8. 

the  experts  used  in  Research  Hypothesis  2  were  again  used 

with  the  exception  of  two  individuals  who  were  not  available. 

One  additional  ASD  expert  was  then  selected  and  one  of  the 

attorneys  was  used  to  replace  the  two  individuals. 

The  thirteen  Air  Force  experts  used  are  listed  below. 

Mr.  Carl  L.  Beehler 
Contracting  Officer 

EF-111A  Technical  Jamming  System  SPO 
Aeronautical  Systems  Division  (ASSC) 

Wright -Patter son  Air  Force  Base,  Ohio 

Ms.  Marjorie  Charlton 

Contract . Negotiator  ( PCO_)/Procurement  Analyst 
Aeronautical  Systems  Division  (AFSC) 

Wright-Patterson  Air  Force  Base,  Ohio 

Mr.  Jack  D.  Falleur 

Chairman,  Contract  Review  Committee 

Aeronautical  Systems  Division  (AFSC) 

Wright-Patterson  Air  Force  Base,  Ohio 
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Mr.  Peter  G.  Gagaris 

Contracting  Officer 

Contracting  Division  A 

Deputy  for  Propulsion 

Aeronautical  Systems  Division  (AFSC) 

Wright-Patterson  Air  Force  Base,  Ohio 

Mr.  Robert  S.  Kinderman 
Director  of  Contractual  Instruments 
Deputy  for  Contracting  and  Manufacturing 
Aeronautical  Systems  Division  (AFSC) 
Wright-Patterson  Air  Force  Base,  Ohio 

Mr.  Willie  E.  Live say 
Contract  Negotiator  (PCO) 

Deputy  for  Strategic  Systems 
Aeronautical  Systems  Division  (AFSC) 
Wright-Patterson  Air  Force  Base,  Ohio 

Mr.  Christe  P.  Mengos 

Contracting  Officer/Contract  Negotiator 
PELS/RPV  SPO 

Aeronautical  Systems  Division  (AFSC) 
Wright-Patterson  Air  Force  Base,  Ohio 

Mr.  Carroll  L.  Miller 
Contracting  Negotiator 
Aeronautical  Systems  Division  (AFSC) 
Wright-Patterson  Air  Force  Base,  Ohio 

Lieutenant  Colonel  Norman  S.  Pattison 
Judge  Advocate 

Procurement  Opinion  Division  (AFLC) 
Wright-Patterson  Air  Force  Base,  Ohio 
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